00010000:00010000:1.0F:1782107197.444656:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782107198.411021:0:7431:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967332 is committed 00000020:00080000:1.0:1782107198.411042:0:7431:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 6 batchid updated 00000020:00080000:1.0:1782107198.411082:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 6 00000004:00080000:1.0:1782107198.411152:0:7453:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08c601e0900 with version 15 00000020:00080000:1.0:1782107198.411163:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 6 cancel update log [0x200000401:0x3:0x0].6: rc = 0 00000020:00080000:1.0:1782107198.411231:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 6 cancel update log [0x240000400:0x3:0x0].6: rc = 0 00000020:00080000:1.0:1782107198.411237:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 6 00000004:00080000:1.0:1782107198.411246:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 15 rpc_version 15 00000020:00100000:1.0:1782107198.411282:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782107198.411295:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c81ae1880 x1868674269176704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782107198.411317:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c81ae1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269176704:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782107198.411383:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107198.411451:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b428c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107198.411472:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269176704 00000100:00100000:1.0:1782107198.411478:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269176704 00000100:00100000:1.0:1782107198.411525:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1782107198.411535:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7445:x1868674269176704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782107198.411649:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a5f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7445:x1868674269176704:12345-0@lo:1000:osp_up0-1.0 Request processed in 116us (266us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1782107198.411657:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1782107198.411707:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c81ae1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269176704:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0F:1782107198.468767:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1782107198.751580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0F:1782107198.751779:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246991616 00000100:00100000:0.0:1782107198.751794:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246991616 00000100:00100000:0.0:1782107198.751858:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00100000:0.0:1782107198.751868:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:36043:x1868674246991616:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1782107198.751891:0:7836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107198.751911:0:7836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f5e expref: -99 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.751973:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.751989:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.752000:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107198.752111:0:7836:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x14:0x0]: returning size 4096 00000004:00200000:0.0:1782107198.752116:0:7836:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1782107198.752135:0:7836:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.752160:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f5e expref: 12 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.752175:0:7836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f5e expref: 11 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.752184:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffffa08c43d2bd00) 00010000:00010000:0.0:1782107198.752187:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107198.752191:0:7836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942c00, rc 0) 00000100:00100000:0.0:1782107198.752251:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+11:36043:x1868674246991616:12345-192.168.203.43@tcp:101:rm.0 Request processed in 384us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107198.752258:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 235 00000100:00080000:1.0:1782107198.752648:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107198.757586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107198.757708:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246991744 00000100:00100000:0.0:1782107198.757717:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246991744 00000100:00100000:0.0:1782107198.757833:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:0.0:1782107198.757843:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+11:36043:x1868674246991744:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1782107198.757863:0:18105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107198.758596:0:18105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13314 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f65 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.758673:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a1331b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.758688:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a1331b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.758699:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a1331b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107198.758857:0:18105:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1782107198.758863:0:18105:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1782107198.758970:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13314 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f65 expref: 13 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.758986:0:18105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a1331b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f65 expref: 12 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.758995:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffffa08b42efa300) 00010000:00010000:0.0:1782107198.759003:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782107198.759008:0:18105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b943400, rc 0) 00000100:00100000:0.0:1782107198.759077:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:36043:x1868674246991744:12345-192.168.203.43@tcp:101:rm.0 Request processed in 1235us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107198.759085:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 236 00000100:00100000:2.0:1782107198.770532:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107198.770811:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992000 00000100:00100000:3.0:1782107198.770821:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992000 00000100:00100000:3.0:1782107198.770873:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:3.0:1782107198.770884:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:36043:x1868674246992000:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:3.0:1782107198.770903:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107198.770922:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f6c expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107198.771069:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x14:0x0]: returning size 4096 00010000:00010000:3.0:1782107198.771161:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13322 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f6c expref: 14 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.771176:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107198.771179:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782107198.771185:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f6c expref: 14 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.771197:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907600, rc 0) 00000100:00100000:3.0:1782107198.771255:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+13:36043:x1868674246992000:12345-192.168.203.43@tcp:101:rm.0 Request processed in 373us (731us total) trans 4294967382 rc 301/301 00000100:00100000:3.0:1782107198.771263:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 237 00000100:00100000:1.0:1782107198.786704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107198.789005:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992128 00000100:00100000:0.0:1782107198.789017:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992128 00000100:00100000:0.0:1782107198.789093:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1782107198.789103:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c51159450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+13:36043:x1868674246992128:12345-192.168.203.43@tcp:37:rm.0 00000100:00100000:0.0:1782107198.797136:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c51159450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+13:36043:x1868674246992128:12345-192.168.203.43@tcp:37:rm.0 Request processed in 8025us (10432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107198.797150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1782107198.806652:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107198.809592:0:6520:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992256 00000100:00100000:1.0:1782107198.809606:0:6520:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992256 00000100:00100000:1.0:1782107198.809726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:1.0:1782107198.809736:0:6520:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36043:x1868674246992256:12345-192.168.203.43@tcp:37:rm.0 00000100:00080000:2.0:1782107198.811039:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782107198.817192:0:6520:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36043:x1868674246992256:12345-192.168.203.43@tcp:37:rm.0 Request processed in 7446us (10536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.817206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:0.0:1782107198.827718:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107198.827851:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992512 00000100:00100000:1.0:1782107198.827861:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992512 00000100:00100000:1.0:1782107198.827991:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1782107198.828001:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+13:36043:x1868674246992512:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:1.0:1782107198.828219:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:36043:x1868674246992512:12345-192.168.203.43@tcp:35:rm.0 Request processed in 219us (506us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1782107198.828226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1782107198.837806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107198.837888:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992768 00000100:00100000:0.0:1782107198.837897:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992768 00000100:00100000:0.0:1782107198.837953:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:0.0:1782107198.837963:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:36043:x1868674246992768:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1782107198.837986:0:7836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107198.838004:0:7836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f73 expref: -99 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.838158:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13337 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.838172:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.838181:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107198.838200:0:7836:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x14:0x0]: returning size 4096 00010000:00010000:0.0:1782107198.838284:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f73 expref: 17 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.838299:0:7836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f73 expref: 16 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.838308:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffffa08c43d2bd00) 00010000:00010000:0.0:1782107198.838310:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782107198.838315:0:7836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b943000, rc 0) 00000100:00100000:0.0:1782107198.838372:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:36043:x1868674246992768:12345-192.168.203.43@tcp:101:rm.0 Request processed in 411us (575us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1782107198.838379:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 238 00000100:00100000:1.0:1782107198.849823:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107198.853134:0:6517:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246992896 00000100:00100000:2.0:1782107198.853147:0:6517:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246992896 00000100:00100000:2.0:1782107198.853255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:2.0:1782107198.853266:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:36043:x1868674246992896:12345-192.168.203.43@tcp:41:rm.0 00000004:00000024:2.0:1782107198.853320:0:6517:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1782107198.853422:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:36043:x1868674246992896:12345-192.168.203.43@tcp:41:rm.0 Request processed in 158us (3607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107198.853430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 239 00000100:00100000:3.0:1782107198.862193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107198.862222:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246993024 00000100:00100000:3.0:1782107198.862230:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246993024 00000100:00100000:3.0:1782107198.862272:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:3.0:1782107198.862280:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:36043:x1868674246993024:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:3.0:1782107198.862299:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107198.862321:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13345 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f7a expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862378:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862392:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862424:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862437:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862444:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862450:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862531:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862540:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862546:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107198.862581:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x15:0x0]: returning size 0 00000004:00200000:3.0:1782107198.862585:0:8982:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782107198.862601:0:8982:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862617:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862626:0:8982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862632:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862637:0:8982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862643:0:8982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862649:0:8982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.862653:0:8982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862660:0:8982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862671:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffffa08b42efa300) 00010000:00010000:3.0:1782107198.862674:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107198.862679:0:8982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862684:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1334c lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862693:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862704:0:8982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862710:0:8982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862714:0:8982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.862717:0:8982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862723:0:8982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862729:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffffa08c43d2b000) 00010000:00010000:3.0:1782107198.862732:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107198.862734:0:8982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862740:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13353 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862764:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13345 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f7a expref: 18 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862956:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f7a expref: 17 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.862965:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffffa08c7a609000) 00010000:00010000:3.0:1782107198.862967:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782107198.862975:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907400, rc 0) 00000100:00100000:3.0:1782107198.863029:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+17:36043:x1868674246993024:12345-192.168.203.43@tcp:101:rm.0 Request processed in 749us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107198.863036:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 240 00000100:00100000:2.0:1782107198.872038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107198.872324:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246993280 00000100:00100000:3.0:1782107198.872335:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246993280 00000100:00100000:3.0:1782107198.872390:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:3.0:1782107198.872416:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+17:36043:x1868674246993280:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:3.0:1782107198.872483:0:7836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782107198.872509:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a1335a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f7a expref: 17 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872526:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffffa08c7a609000) 00010000:00010000:3.0:1782107198.872543:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a1331b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f65 expref: 16 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872551:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffffa08b42efa300) 00010000:00010000:3.0:1782107198.872557:0:7836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782107198.872577:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872591:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872599:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872609:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872628:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872635:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872707:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872716:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872723:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872892:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872901:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872909:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872916:0:7836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872922:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872928:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872962:0:7836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782107198.872981:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872987:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.872987:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107198.872992:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.872993:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.872999:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1782107198.872999:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906800 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:3.0:1782107198.873003:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.873003:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.873011:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.873011:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.876673:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffffa08c7a609600) 00010000:00010000:2.0:1782107198.876681:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782107198.876689:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.876699:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13376 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.876728:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107198.876848:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107198.876851:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107198.878365:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffffa08c7a609600) 00010000:00010000:3.0:1782107198.878372:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782107198.878380:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878390:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a1336f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878436:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878444:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878567:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878573:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.878577:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878585:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878599:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffffa08c7a609a00) 00010000:00010000:3.0:1782107198.878602:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107198.878605:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878611:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13361 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782107198.878625:0:7836:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000539b7974 reply state 000000007732b942 transno 4294967385 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878637:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.878644:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffffa08c43d2b000) 00010000:00010000:3.0:1782107198.878647:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782107198.878650:0:7836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782107198.878739:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+17:36043:x1868674246993280:12345-192.168.203.43@tcp:36:rm.0 Request processed in 6336us (6706us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1782107198.878748:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 241 00000100:00100000:3.0:1782107198.881070:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107198.881102:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246993536 00000100:00100000:3.0:1782107198.881110:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246993536 00000100:00100000:3.0:1782107198.881153:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1782107198.881162:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+17:36043:x1868674246993536:12345-192.168.203.43@tcp:35:rm.0 00000100:00100000:3.0:1782107198.881357:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+18:36043:x1868674246993536:12345-192.168.203.43@tcp:35:rm.0 Request processed in 195us (305us total) trans 4294967386 rc 0/0 00000100:00100000:3.0:1782107198.881365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1782107198.889629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107198.889661:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246993792 00000100:00100000:3.0:1782107198.889670:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246993792 00000100:00100000:3.0:1782107198.889723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 242 00000100:00100000:3.0:1782107198.889747:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+18:36043:x1868674246993792:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:3.0:1782107198.889804:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1782107198.889829:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f73 expref: 18 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889849:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a1330d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f5e expref: 17 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889862:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a1329d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f34 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889873:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffffa08c43d2bd00) 00010000:00010000:3.0:1782107198.889889:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a13281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f2d expref: 15 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889915:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107198.889919:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782107198.889938:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889952:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889962:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889976:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889982:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.889989:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890074:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890082:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890090:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890108:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890129:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890136:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890169:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890176:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890184:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107198.890206:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1868674269176832:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782107198.890253:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107198.890298:0:6517:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782107198.890317:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269176832 00000100:00100000:3.0:1782107198.890321:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269176832 00000100:00100000:3.0:1782107198.890349:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1782107198.890355:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1868674269176832:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782107198.890364:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107198.890376:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13399 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890394:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 5 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890444:0:6521:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890465:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 5 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.890477:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 5 pid: 8982 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107198.890488:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7a409f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6521:1868674269176960:192.168.203.43@tcp:104: 00000100:00100000:3.0:1782107198.890538:0:6521:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af0600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107198.893090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107198.893168:0:6521:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7a409f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6521:1868674269176960:192.168.203.43@tcp:104: 00010000:00010000:1.0:1782107198.893201:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893214:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffffa08c43d2b600) 00010000:00010000:1.0:1782107198.893217:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782107198.893221:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893230:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893237:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42906400, rc 0) 00000100:00100000:1.0:1782107198.893300:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1868674269176832:12345-0@lo:101:mdt00_001.0 Request processed in 2944us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.893308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1782107198.893347:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246993920 00000100:00100000:1.0:1782107198.893353:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246993920 00010000:00010000:1.0:1782107198.893379:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 6 pid: 8982 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107198.893430:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:1.0:1782107198.893439:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2414:x1868674246993920:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782107198.893452:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107198.893458:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 6 pid: 8982 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893470:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 6 pid: 8982 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893492:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a132b9 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f42 expref: 6 pid: 8982 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893631:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffffa08c43d2b600) 00010000:00010000:1.0:1782107198.893636:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893646:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893654:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893692:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107198.893704:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42fe5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6503:1868674269177088:0@lo:105: 00000100:00100000:1.0:1782107198.893860:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107198.893892:0:6503:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b428c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782107198.893911:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177088 00000100:00100000:1.0:1782107198.893914:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177088 00000100:00100000:1.0:1782107198.893943:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782107198.893949:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6503:x1868674269177088:12345-0@lo:105: 00010000:00010000:1.0:1782107198.893958:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893966:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893974:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893982:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893988:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.893996:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107198.894019:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffffa08b42907e00) 00000100:00100000:1.0:1782107198.894048:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6503:x1868674269177088:12345-0@lo:105: Request processed in 100us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.894065:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782107198.894096:0:6503:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42fe5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6503:1868674269177088:0@lo:105: 00010000:00010000:1.0:1782107198.894106:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107198.894140:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674246993920:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 703us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.894147:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 82 00000100:00100000:3.0:1782107198.897929:0:6517:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967332 gen 2 00000004:00080000:3.0:1782107198.897940:0:6517:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967329 committed transno 4294967332 00000020:00080000:3.0:1782107198.897947:0:6517:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa08c81af0c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782107198.897952:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b42d68200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa08c81af0f00 00000020:00080000:3.0:1782107198.897955:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].2 00000020:00080000:3.0:1782107198.897958:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b42d68f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa08b4154a000 00000020:00080000:3.0:1782107198.897960:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].2 00000020:00080000:0.0:1782107198.898000:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:0.0:1782107198.898071:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1782107198.898841:0:6517:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967330 committed transno 4294967332 00000020:00080000:3.0:1782107198.898847:0:6517:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa08c81af0180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782107198.898851:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b42d68700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa08c81af0240 00000020:00080000:3.0:1782107198.898854:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].3 00000020:00080000:3.0:1782107198.898856:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b42d68b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa08c41285200 00000020:00080000:3.0:1782107198.898869:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].3 00000020:00080000:0.0:1782107198.898905:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782107198.898933:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1782107198.898969:0:6517:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967331 committed transno 4294967332 00000020:00080000:3.0:1782107198.898974:0:6517:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa08b429800c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1782107198.898977:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b434e5a00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa08b42980900 00000020:00080000:3.0:1782107198.898979:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].4 00000020:00080000:3.0:1782107198.898981:0:6517:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b434e5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa08b42c45600 00000020:00080000:3.0:1782107198.898984:0:6517:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].4 00000020:00080000:0.0:1782107198.899017:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1782107198.899035:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1782107198.899077:0:6517:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967332 committed transno 4294967332 00000100:00100000:3.0:1782107198.899093:0:6517:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1868674269176832:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782107198.899113:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107198.901145:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1868674269177216:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1782107198.901213:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107198.901279:0:6517:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782107198.905649:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177216 00000100:00100000:1.0:1782107198.905661:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177216 00000100:00100000:1.0:1782107198.905760:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1782107198.905771:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1868674269177216:12345-0@lo:403:mdt00_001.0 00000100:00100000:1.0:1782107198.910131:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1868674269177216:12345-0@lo:403:mdt00_001.0 Request processed in 4354us (8909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.910145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1782107198.910906:0:6517:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6517:1868674269177216:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1782107198.912121:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].5, 936 off39288 00000040:00080000:3.0:1782107198.912257:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].5, 1016 off39928 00000004:00080000:3.0:1782107198.912264:0:6517:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08c81af0e40 with version 9 00000004:00080000:3.0:1782107198.912288:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 9 rpc_version 9 00000020:00100000:3.0:1782107198.912313:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782107198.912322:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c7a408a80 x1868674269177472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782107198.912341:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269177472:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782107198.912425:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107198.913036:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782107198.913632:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177472 00000100:00100000:0.0:1782107198.913641:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177472 00000100:00100000:0.0:1782107198.913730:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1782107198.913740:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7831:x1868674269177472:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782107198.914048:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7831:x1868674269177472:12345-0@lo:1000:osp_up1-0.0 Request processed in 310us (1622us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1782107198.914067:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1782107198.914161:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7a408a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269177472:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1782107198.914187:0:6517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x14:0x0]: returning size 4096 00010000:00010000:3.0:1782107198.914205:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914214:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914222:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914228:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.914232:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914240:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914253:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffffa08c7a609200) 00010000:00010000:3.0:1782107198.914256:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782107198.914261:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914267:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13392 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914284:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914293:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914309:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914330:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782107198.914337:0:6517:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:3.0:1782107198.914344:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914350:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914355:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914360:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906e00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.914363:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914369:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914379:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffffa08c7a609c00) 00010000:00010000:3.0:1782107198.914381:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782107198.914384:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914388:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a1338b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914429:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914441:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914446:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914451:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914456:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107198.914458:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914464:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914472:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107198.914474:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107198.914477:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914483:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a1337d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782107198.914491:0:6517:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000d415f68 reply state 00000000c3bf7a59 transno 4294967387 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914502:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107198.914510:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5a715935 (ffffa08c7a609d00) 00010000:00010000:3.0:1782107198.914517:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782107198.914521:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782107198.914586:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:36043:x1868674246993792:12345-192.168.203.43@tcp:36:rm.0 Request processed in 24853us (24965us total) trans 4294967387 rc 0/0 00000100:00100000:3.0:1782107198.914594:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 242 00010000:00010000:2.0:1782107198.915007:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107198.915014:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.915022:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907e00 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:2.0:1782107198.915026:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107198.915034:0:6505:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.915075:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.915082:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782107198.915111:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.915118:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08b42907e00/0x7e3d6a8eb3a13399 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107198.915132:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107198.915133:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107198.915135:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107198.915142:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107198.915154:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269177600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782107198.915200:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107198.916430:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177600 00000100:00100000:0.0:1782107198.916440:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177600 00000100:00100000:0.0:1782107198.916491:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782107198.916502:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3658:x1868674269177600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782107198.916516:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107198.916546:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a133a0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13399 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107198.916561:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffffa08c43d2b600) 00010000:00010000:0.0:1782107198.916570:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107198.916626:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1868674269177600:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107198.916633:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782107198.916743:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269177600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782107198.916895:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269177728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782107198.916930:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107198.916974:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177728 00000100:00100000:1.0:1782107198.916979:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177728 00000100:00100000:1.0:1782107198.917017:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1782107198.917026:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1868674269177728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782107198.917847:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:1.0:1782107198.917908:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1868674269177728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 883us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107198.917931:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1782107198.917940:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269177728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782107199.427891:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107199.427915:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269177856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782107199.427998:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107199.428375:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269177984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107199.428434:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107199.428527:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177856 00000100:00100000:1.0:1782107199.428534:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177856 00000100:00100000:1.0:1782107199.428584:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269177984 00000100:00100000:1.0:1782107199.428588:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269177984 00000100:00100000:1.0:1782107199.428608:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1782107199.428617:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1868674269177856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782107199.428644:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107199.428690:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1868674269177856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107199.428697:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1782107199.428714:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1782107199.428719:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269177984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107199.428728:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107199.428752:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269177984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107199.428757:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1782107199.428797:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269177856:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782107199.428906:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107199.428931:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269177984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782107199.492080:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107199.772162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107199.772210:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107199.772246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107199.772385:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994304 00000100:00100000:1.0:1782107199.772395:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994304 00000100:00100000:1.0:1782107199.772490:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994176 00000100:00100000:1.0:1782107199.772494:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994176 00000100:00100000:1.0:1782107199.772516:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 653 00000100:00100000:1.0:1782107199.772526:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2411:x1868674246994304:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107199.772595:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2411:x1868674246994304:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107199.772617:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 653 00000100:00100000:1.0:1782107199.772634:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 654 00000100:00100000:1.0:1782107199.772639:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:2411:x1868674246994176:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107199.772670:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:2411:x1868674246994176:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107199.772676:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 654 00000100:00100000:3.0:1782107199.772833:0:6510:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994048 00000100:00100000:3.0:1782107199.772837:0:6510:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994048 00000100:00100000:3.0:1782107199.772876:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 435 00000100:00100000:3.0:1782107199.773030:0:6510:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c42d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2411:x1868674246994048:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107199.773083:0:6510:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c42d5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2411:x1868674246994048:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 200us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107199.773090:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 435 00000100:00100000:3.0:1782107199.940371:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107199.940391:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269178112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782107199.940476:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107199.940533:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178112 00000100:00100000:3.0:1782107199.940540:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178112 00000100:00100000:3.0:1782107199.940591:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1782107199.940599:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269178112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782107199.940626:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782107199.940679:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269178112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107199.940685:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00080000:3.0:1782107199.940719:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa08c7fc26300 x1868674269178112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107199.940736:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269178112:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1782107199.940761:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107199.941015:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269178240:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941057:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941081:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269178752:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941103:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941117:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269179264:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941135:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941150:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782107199.941155:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269178368:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941175:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941188:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269178880:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941229:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941244:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269179392:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941262:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941284:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269178624:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941302:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941315:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269179136:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941342:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269179648:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941357:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941369:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782107199.941373:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269178496:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941389:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941418:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269179008:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941434:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941449:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1868674269179520:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941466:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107199.941492:0:6511:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178240 00000100:00100000:0.0:1782107199.941496:0:6511:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178240 00000100:00100000:0.0:1782107199.941526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1782107199.941531:0:6511:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c42d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269178240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941567:0:6511:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c42d5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269178240:12345-0@lo:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.941573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1782107199.941597:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178752 00000100:00100000:0.0:1782107199.941605:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178752 00000100:00100000:0.0:1782107199.941637:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178496 00000100:00100000:0.0:1782107199.941640:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178496 00000100:00100000:0.0:1782107199.941661:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1782107199.941668:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c81ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1868674269178752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.941718:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c81ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1868674269178752:12345-0@lo:400:kworker.0 Request processed in 49us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.941723:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1782107199.942263:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1782107199.942272:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3659:x1868674269178496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942325:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3659:x1868674269178496:12345-0@lo:400:kworker.0 Request processed in 55us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942331:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1782107199.942350:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179264 00000100:00100000:0.0:1782107199.942354:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179264 00000100:00100000:0.0:1782107199.942384:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179136 00000100:00100000:0.0:1782107199.942387:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179136 00000100:00100000:0.0:1782107199.942397:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179648 00000100:00100000:0.0:1782107199.942420:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179648 00000100:00100000:0.0:1782107199.942446:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782107199.942452:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c81ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269179264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942481:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c81ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269179264:12345-0@lo:400:kworker.0 Request processed in 29us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942488:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782107199.942499:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782107199.942504:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269179136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942529:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269179136:12345-0@lo:400:kworker.0 Request processed in 25us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942546:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782107199.942558:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782107199.942564:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942591:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269179648:12345-0@lo:400:kworker.0 Request processed in 28us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942597:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782107199.942613:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178368 00000100:00100000:0.0:1782107199.942616:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178368 00000100:00100000:0.0:1782107199.942630:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178880 00000100:00100000:0.0:1782107199.942632:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178880 00000100:00100000:0.0:1782107199.942641:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179392 00000100:00100000:0.0:1782107199.942644:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179392 00000100:00100000:0.0:1782107199.942652:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269178624 00000100:00100000:0.0:1782107199.942654:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269178624 00000100:00100000:0.0:1782107199.942664:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179008 00000100:00100000:0.0:1782107199.942666:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179008 00000100:00100000:0.0:1782107199.942677:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179520 00000100:00100000:0.0:1782107199.942679:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179520 00000100:00100000:0.0:1782107199.942690:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1782107199.942695:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a5f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269178368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942720:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a5f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269178368:12345-0@lo:400:kworker.0 Request processed in 25us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942725:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1782107199.942735:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1782107199.942739:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269178880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.942760:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269178880:12345-0@lo:400:kworker.0 Request processed in 21us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.942765:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1782107199.943384:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269178496:0@lo:400:kworker.0 00000100:00100000:2.0:1782107199.943421:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269179136:0@lo:400:kworker.0 00010000:00080000:2.0:1782107199.943435:0:3659:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa08c447f2a00 x1868674269179648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107199.943445:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269179648:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.944983:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1782107199.945001:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.945083:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269179392:12345-0@lo:400:kworker.0 Request processed in 89us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.945090:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1782107199.945913:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107199.945936:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269179776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107199.945983:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107199.946072:0:8402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269179776 00000100:00100000:3.0:1782107199.946080:0:8402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269179776 00000100:00100000:3.0:1782107199.946125:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1782107199.946133:0:8402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269179776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107199.946150:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782107199.946186:0:8402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269179776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107199.946193:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00080000:3.0:1782107199.946237:0:3661:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa08c7fca2680 x1868674269179776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107199.946255:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269179776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107199.946500:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1782107199.946510:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.946585:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269178624:12345-0@lo:400:kworker.0 Request processed in 77us (5281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.946592:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1782107199.946607:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1782107199.946614:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.946641:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269179008:12345-0@lo:400:kworker.0 Request processed in 29us (5206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.946647:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1782107199.946658:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1782107199.946664:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1868674269179520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.946687:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1868674269179520:12345-0@lo:400:kworker.0 Request processed in 24us (5221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107199.946692:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00080000:0.0:1782107199.946747:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782107199.946751:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782107199.946754:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107199.946780:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269178368:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.946791:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269178880:0@lo:400:kworker.0 00000100:00100000:3.0:1782107199.947310:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269179008:0@lo:400:kworker.0 00000100:00100000:3.0:1782107199.947322:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1868674269179520:0@lo:400:kworker.0 00000100:00100000:3.0:1782107199.947331:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269178624:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.948094:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269179392:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.948106:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269178240:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.948192:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269178752:0@lo:400:kworker.0 00000100:00100000:0.0:1782107199.948278:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269179264:0@lo:400:kworker.0 00000001:00080000:1.0:1782107200.458380:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967387 is committed 00000020:00080000:1.0:1782107200.458415:0:6495:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1782107200.458422:0:6495:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1782107200.458425:0:6495:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:1.0:1782107200.458442:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967381 is committed 00000020:00080000:1.0:1782107200.458459:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1782107200.458521:0:6548:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08b43431540 with version 10 00000020:00080000:1.0:1782107200.458530:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 2 cancel update log [0x240000401:0x3:0x0].2: rc = 0 00000020:00080000:1.0:1782107200.458606:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 2 cancel update log [0x200000400:0x3:0x0].2: rc = 0 00000004:00080000:1.0:1782107200.458631:0:6548:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08b43431a80 with version 11 00000020:00080000:1.0:1782107200.458634:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 3 cancel update log [0x240000401:0x3:0x0].3: rc = 0 00000020:00080000:1.0:1782107200.458661:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 3 cancel update log [0x200000400:0x3:0x0].3: rc = 0 00000004:00080000:1.0:1782107200.458681:0:6548:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08b434313c0 with version 12 00000020:00080000:1.0:1782107200.458684:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4 cancel update log [0x240000401:0x3:0x0].4: rc = 0 00000020:00080000:1.0:1782107200.458702:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4 cancel update log [0x200000400:0x3:0x0].4: rc = 0 00000020:00080000:1.0:1782107200.458708:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1782107200.458937:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.458950:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.458957:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.458963:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b43418000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107200.458968:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.458975:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.458992:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffffa08c43d2b000) 00010000:00010000:3.0:1782107200.458995:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107200.459000:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459007:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418000/0x7e3d6a8eb3a132e3 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459025:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459032:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459039:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459066:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107200.459070:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459076:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459084:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffffa08c43d2b000) 00010000:00010000:3.0:1782107200.459087:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107200.459090:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459095:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a13368 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459113:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459118:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459124:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459128:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107200.459131:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459136:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459155:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5a715935 (ffffa08c7a609d00) 00010000:00010000:3.0:1782107200.459157:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107200.459161:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.459167:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13384 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782107200.459186:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 10 rpc_version 10 00000020:00100000:3.0:1782107200.460391:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782107200.460432:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c7fc26680 x1868674269180032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782107200.460457:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fc26680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180032:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782107200.460526:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.460577:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.461949:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180032 00000100:00100000:1.0:1782107200.461961:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180032 00000100:00100000:1.0:1782107200.462027:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1782107200.462054:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7831:x1868674269180032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782107200.463706:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7831:x1868674269180032:12345-0@lo:1000:osp_up1-0.0 Request processed in 1658us (3175us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1782107200.463719:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1782107200.464076:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fc26680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180032:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1782107200.464092:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 11 rpc_version 11 00000020:00100000:2.0:1782107200.464117:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782107200.464123:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c7fca2680 x1868674269180288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782107200.464143:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180288:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782107200.464195:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.466078:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180288 00000100:00100000:3.0:1782107200.466091:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180288 00000100:00100000:3.0:1782107200.466158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1782107200.466169:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7831:x1868674269180288:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782107200.466358:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7831:x1868674269180288:12345-0@lo:1000:osp_up1-0.0 Request processed in 193us (2163us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1782107200.466365:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1782107200.468254:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19780 going to sleep for 11 seconds 00000100:00100000:0.0:1782107200.468309:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca2680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180288:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1782107200.468323:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 12 rpc_version 12 00000020:00100000:0.0:1782107200.468348:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107200.468355:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b4354ed80 x1868674269180544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107200.468376:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180544:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782107200.468445:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.468473:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1782107200.468935:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180544 00000100:00100000:2.0:1782107200.468942:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180544 00000100:00100000:2.0:1782107200.468986:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1782107200.468995:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7831:x1868674269180544:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782107200.469177:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7831:x1868674269180544:12345-0@lo:1000:osp_up1-0.0 Request processed in 183us (731us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1782107200.469214:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1782107200.469262:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269180544:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1782107200.515809:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107200.583525:0:22880:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 25a: lfs find with --component-flags parity ========================================================== 01:46:39 (1782107199) 00000100:00100000:3.0:1782107200.732931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107200.733024:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994432 00000100:00100000:1.0:1782107200.733034:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994432 00000100:00100000:1.0:1782107200.733118:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 243 00000100:00100000:1.0:1782107200.733129:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:36215:x1868674246994432:12345-192.168.203.43@tcp:41:stat.0 00000004:00000024:1.0:1782107200.733180:0:18105:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1782107200.733247:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:36215:x1868674246994432:12345-192.168.203.43@tcp:41:stat.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.733254:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 243 00000100:00080000:3.0:1782107200.733928:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107200.807376:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.807432:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994560 00000100:00100000:0.0:1782107200.807442:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994560 00000100:00100000:0.0:1782107200.808867:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:0.0:1782107200.808884:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:36219:x1868674246994560:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.808905:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.808922:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a133a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f81 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.808981:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.809005:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.809017:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107200.809069:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782107200.809072:0:8982:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782107200.809092:0:8982:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.809113:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a133a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 7 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.809130:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 6 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.809138:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107200.809141:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107200.809144:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b943000, rc 0) 00000100:00100000:0.0:1782107200.809201:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36219:x1868674246994560:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 324us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.809207:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 244 00000100:00100000:1.0:1782107200.812426:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.813429:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994688 00000100:00100000:0.0:1782107200.813441:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994688 00000100:00100000:0.0:1782107200.813638:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00100000:0.0:1782107200.813649:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36219:x1868674246994688:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.813670:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.813696:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a133b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f88 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813753:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813907:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813923:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813930:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813937:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813974:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813982:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813989:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.813996:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814002:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b943400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107200.814011:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814019:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814030:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107200.814033:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.814038:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814059:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a133bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814072:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814078:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814084:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814090:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b942800 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107200.814092:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814097:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814104:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffffa08b42efae00) 00010000:00010000:0.0:1782107200.814106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.814114:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814120:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a133c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814150:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a133b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f88 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814159:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107200.814162:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.814165:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a133b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f88 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.814174:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942000, rc 0) 00000100:00100000:0.0:1782107200.814240:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36219:x1868674246994688:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 593us (1840us total) trans 0 rc 301/301 00000100:00100000:0.0:1782107200.817944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 245 00000100:00100000:2.0:1782107200.829601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.829682:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246994944 00000100:00100000:0.0:1782107200.829693:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246994944 00000100:00100000:0.0:1782107200.829772:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 246 00000100:00100000:0.0:1782107200.829784:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:36219:x1868674246994944:12345-192.168.203.43@tcp:36:lfs.0 00000100:00100000:0.0:1782107200.829898:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180672:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1782107200.829948:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.829990:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782107200.830009:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180672 00000100:00100000:0.0:1782107200.830013:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180672 00000100:00100000:0.0:1782107200.830051:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1782107200.830059:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:18105:x1868674269180672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1782107200.830141:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:18105:x1868674269180672:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.830148:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1782107200.830185:0:18105:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967381 gen 2 00000004:00080000:0.0:1782107200.830190:0:18105:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967381 committed transno 4294967381 00000100:00100000:0.0:1782107200.830209:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180672:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1782107200.830245:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180800:0@lo:1000:mdt00_005.0 00000100:00080000:3.0:1782107200.830355:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782107200.830431:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.830449:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.830516:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180800 00000100:00100000:3.0:1782107200.830521:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180800 00000100:00100000:3.0:1782107200.830564:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1782107200.830571:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:18105:x1868674269180800:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107200.830646:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:18105:x1868674269180800:12345-0@lo:1000:mdt00_005.0 Request processed in 76us (214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782107200.830652:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1782107200.830679:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180800:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1782107200.830721:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830731:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830740:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107200.830752:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fc25500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180928:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782107200.830776:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.830798:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af0600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.830809:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269180928 00000100:00100000:3.0:1782107200.830813:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269180928 00000100:00100000:3.0:1782107200.830835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1782107200.830841:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:18105:x1868674269180928:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107200.830849:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107200.830862:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a133ca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830886:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 5 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830908:0:6521:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830933:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 5 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.830946:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 5 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107200.830957:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fc26a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6521:1868674269181056:192.168.203.43@tcp:104: 00000100:00100000:3.0:1782107200.831008:0:6521:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.833796:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107200.834233:0:6521:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fc26a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6521:1868674269181056:192.168.203.43@tcp:104: 00010000:00010000:3.0:1782107200.834331:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.834345:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107200.834348:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107200.834352:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.834363:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907000, rc 0) 00000100:00100000:2.0:1782107200.834536:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995072 00000100:00100000:2.0:1782107200.834543:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995072 00010000:00010000:2.0:1782107200.834832:0:9469:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 6 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.834910:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1782107200.834921:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2413:x1868674246995072:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782107200.834935:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107200.834941:0:9469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 6 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.834951:0:9469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 6 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.834970:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a133ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f81 expref: 6 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.834983:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:2.0:1782107200.834988:0:9469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.834996:0:9469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.835016:0:9469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.835059:0:9469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.835071:0:9469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9469:1868674269181184:0@lo:105: 00000100:00100000:2.0:1782107200.835108:0:9469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.835150:0:9469:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.835603:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:18105:x1868674269180928:12345-0@lo:101:mdt00_005.0 Request processed in 4759us (4823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.835611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1782107200.836006:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181184 00000100:00100000:0.0:1782107200.836012:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181184 00000100:00100000:0.0:1782107200.836059:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782107200.836069:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9469:x1868674269181184:12345-0@lo:105: 00010000:00010000:0.0:1782107200.836080:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836089:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836097:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836106:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836114:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836137:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.836152:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffffa08b42907a00) 00000100:00100000:0.0:1782107200.836196:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9469:x1868674269181184:12345-0@lo:105: Request processed in 130us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.836203:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782107200.836237:0:9469:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9469:1868674269181184:0@lo:105: 00010000:00010000:0.0:1782107200.836249:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107200.836298:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674246995072:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 1379us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.836305:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 83 00000100:00100000:2.0:1782107200.836468:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fc25500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269180928:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1782107200.836482:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782107200.836500:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1782107200.836530:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.836538:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.836546:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.836561:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181312:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1782107200.836591:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.836609:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.838797:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181312 00000100:00100000:3.0:1782107200.838818:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181312 00000100:00100000:3.0:1782107200.838867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1782107200.838876:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:18105:x1868674269181312:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107200.838896:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107200.838917:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a133d8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.838944:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.838958:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.838966:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffffa08c7a609d00) 00010000:00010000:3.0:1782107200.838969:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107200.838973:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907600, rc 0) 00000100:00100000:3.0:1782107200.839196:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181312:12345-0@lo:101:mdt00_005.0 Request processed in 321us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.839203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1782107200.839671:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181312:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1782107200.839690:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.839701:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782107200.839723:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1782107200.839871:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181440:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1782107200.839911:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.839970:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.840009:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181440 00000100:00100000:3.0:1782107200.840013:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181440 00000100:00100000:3.0:1782107200.840087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1782107200.840095:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181440:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107200.840162:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181440:12345-0@lo:1000:mdt00_005.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.840169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1782107200.840220:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181440:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.840282:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181568:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.840309:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.840606:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19900 going to sleep for 11 seconds 00000100:00100000:0.0:1782107200.840673:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181568 00000100:00100000:0.0:1782107200.840677:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181568 00000100:00100000:1.0:1782107200.840715:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1782107200.840723:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181568:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1782107200.840808:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181568:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782107200.840815:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1782107200.840880:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181568:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.840949:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181696:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.840972:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.840995:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19900 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.841037:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181696 00000100:00100000:1.0:1782107200.841050:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181696 00000100:00100000:1.0:1782107200.841070:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1782107200.841075:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181696:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1782107200.841128:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181696:12345-0@lo:1000:mdt00_005.0 Request processed in 51us (154us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782107200.841134:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1782107200.841191:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181696:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.841234:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181824:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.841256:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.841385:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.841512:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181824 00000100:00100000:3.0:1782107200.841517:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181824 00000100:00100000:3.0:1782107200.841545:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1782107200.841551:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181824:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107200.841610:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181824:12345-0@lo:1000:mdt00_005.0 Request processed in 59us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.841617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1782107200.841672:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181824:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.841712:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181952:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.841734:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.841757:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.841795:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269181952 00000100:00100000:3.0:1782107200.841799:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269181952 00000100:00100000:3.0:1782107200.841817:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:3.0:1782107200.841822:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181952:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107200.841916:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269181952:12345-0@lo:1000:mdt00_005.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.841923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1782107200.842029:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269181952:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.842077:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269182080:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107200.842100:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.842148:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b41c19900 going to sleep for 11 seconds 00000100:00100000:3.0:1782107200.842177:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182080 00000100:00100000:3.0:1782107200.842181:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182080 00000100:00100000:3.0:1782107200.842243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1782107200.842250:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269182080:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107200.842380:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269182080:12345-0@lo:1000:mdt00_005.0 Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.842387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1782107200.842460:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269182080:0@lo:1000:mdt00_005.0 00000040:00080000:2.0:1782107200.843151:0:18105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].7, 2152 off44184 00000040:00080000:2.0:1782107200.843228:0:18105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].7, 2352 off45224 00000004:00080000:2.0:1782107200.843235:0:18105:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08b41c19600 with version 16 00000004:00080000:0.0:1782107200.843439:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 16 rpc_version 16 00000020:00100000:0.0:1782107200.843470:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107200.843477:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b4354fb80 x1868674269182336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107200.843493:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269182336:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782107200.843535:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.843757:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.843807:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182336 00000100:00100000:1.0:1782107200.843813:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182336 00000100:00100000:1.0:1782107200.843845:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1782107200.843851:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7445:x1868674269182336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782107200.844397:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7445:x1868674269182336:12345-0@lo:1000:osp_up0-1.0 Request processed in 544us (860us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1782107200.844423:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1782107200.844657:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269182336:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1782107200.844819:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a133e6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844836:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a133e6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844848:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a133e6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844865:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a133ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844878:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a133ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844885:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a133ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844911:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844918:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.844927:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107200.844941:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7fc26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269182464:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782107200.844972:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.844999:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c81af09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.845053:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182464 00000100:00100000:1.0:1782107200.845058:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182464 00000100:00100000:1.0:1782107200.845092:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1782107200.845100:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269182464:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1782107200.845114:0:7835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107200.845128:0:7835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a133f4 expref: -99 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.845146:0:7835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.845169:0:7835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.845178:0:7835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:1.0:1782107200.845181:0:7835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107200.845185:0:7835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412ea200, rc 0) 00000100:00100000:1.0:1782107200.845225:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:18105:x1868674269182464:12345-0@lo:101:mdt00_005.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.845230:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1782107200.845357:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7fc26a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269182464:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1782107200.845370:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845380:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107200.845429:0:18105:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002fe010c2 reply state 00000000310e31d8 transno 4294967337 ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a133ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845442:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a133ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845449:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffffa08c7a609200) 00010000:00010000:0.0:1782107200.845451:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107200.845455:0:18105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107200.845460:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845467:0:18105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782107200.845475:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x7:0x0] 00000004:00010000:0.0:1782107200.845480:0:18105:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002fe010c2 reply state 00000000310e31d8 transno 4294967337 ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a133e6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845488:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906e00/0x7e3d6a8eb3a133e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845493:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffffa08c7a609c00) 00010000:00010000:0.0:1782107200.845501:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107200.845504:0:18105:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1782107200.845508:0:18105:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096 00000004:00080000:0.0:1782107200.845516:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1782107200.845524:0:18105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845532:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845539:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845556:0:18105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1782107200.845561:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1782107200.845565:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845572:0:18105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107200.845638:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:36219:x1868674246994944:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 15856us (16047us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1782107200.845645:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 246 00010000:00010000:0.0:1782107200.845666:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782107200.845672:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845679:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907a00 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:0.0:1782107200.845690:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107200.845699:0:6504:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845724:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845731:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782107200.845747:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845754:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907a00/0x7e3d6a8eb3a133ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a133d1 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.845767:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107200.845769:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107200.845771:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107200.845778:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107200.845788:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269182592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782107200.845818:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107200.845896:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182592 00000100:00100000:1.0:1782107200.845900:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182592 00000100:00100000:1.0:1782107200.845936:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782107200.845942:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3660:x1868674269182592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782107200.845951:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107200.845964:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a133d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133ca expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.845975:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:1.0:1782107200.845978:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107200.846005:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3660:x1868674269182592:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.846012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782107200.846035:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269182592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782107200.878333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.878426:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995200 00000100:00100000:0.0:1782107200.878436:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995200 00000100:00100000:0.0:1782107200.878501:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:0.0:1782107200.878511:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:36222:x1868674246995200:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.878532:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.878550:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f8f expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878627:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878641:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878653:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107200.878692:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782107200.878696:0:8982:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782107200.878715:0:8982:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878737:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f8f expref: 7 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878754:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f8f expref: 6 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.878776:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107200.878779:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107200.878783:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942800, rc 0) 00000100:00100000:0.0:1782107200.878949:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36222:x1868674246995200:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 438us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.878956:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 247 00000100:00100000:3.0:1782107200.881386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.881512:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995328 00000100:00100000:0.0:1782107200.881521:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995328 00000100:00100000:0.0:1782107200.881590:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 248 00000100:00100000:0.0:1782107200.881600:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:36222:x1868674246995328:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.881619:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.881638:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f96 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881697:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881711:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881722:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881745:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881755:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881764:0:6518:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.881796:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107200.881811:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1868674269182720:0@lo:104: 00000100:00100000:0.0:1782107200.881853:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.881904:0:6518:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.882010:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182720 00000100:00100000:1.0:1782107200.882015:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182720 00000100:00100000:1.0:1782107200.882062:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782107200.882070:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c81ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1868674269182720:12345-0@lo:104: 00010000:00010000:1.0:1782107200.882082:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.882270:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107200.882277:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c81ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6518:x1868674269182720:12345-0@lo:104: Request processed in 208us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.882284:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1782107200.882340:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107200.882353:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.882360:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b43419600 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:2.0:1782107200.882365:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107200.882373:0:6505:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.882396:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.882427:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782107200.882456:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.882465:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b43419600/0x7e3d6a8eb3a133d8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133df expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.882483:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107200.882485:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107200.882487:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107200.882538:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269182848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782107200.882568:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.882847:0:6518:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1868674269182720:0@lo:104: 00010000:00010000:0.0:1782107200.882865:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.882938:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182848 00000100:00100000:2.0:1782107200.882943:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182848 00010000:00010000:3.0:1782107200.883035:0:6502:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107200.883164:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782107200.883172:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3658:x1868674269182848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782107200.883183:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1782107200.890376:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967388 is committed 00010000:00010000:1.0:1782107200.890620:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a133df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7e3d6a8eb3a133d8 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.890640:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffffa08c7a609d00) 00010000:00010000:1.0:1782107200.890650:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.890660:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.890667:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.890702:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107200.890780:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1868674269182848:12345-0@lo:103:ldlm_bl.0 Request processed in 7608us (8209us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.890790:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782107200.890833:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269182848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782107200.890835:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.890845:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107200.890955:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1868674269182976:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782107200.891005:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.891034:0:6518:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1600 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.891080:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269182976 00000100:00100000:1.0:1782107200.891087:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269182976 00000100:00100000:1.0:1782107200.891192:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1782107200.891202:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6518:x1868674269182976:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782107200.891294:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6518:x1868674269182976:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.891301:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1782107200.891358:0:6518:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1868674269182976:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782107200.891415:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13425 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891427:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13425 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891436:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13425 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107200.891456:0:6518:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13425 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891469:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891476:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891487:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891494:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891500:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b942c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107200.891504:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891511:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891520:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107200.891524:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.891528:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891534:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891545:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891550:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891556:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891561:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b943000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107200.891567:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891573:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891580:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffffa08c7a609d00) 00010000:00010000:0.0:1782107200.891582:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.891585:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891590:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1341e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891620:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f96 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891632:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13425 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f96 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.891638:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffffa08c447b8300) 00010000:00010000:0.0:1782107200.891641:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782107200.891643:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942000, rc 0) 00000100:00100000:0.0:1782107200.891691:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:36222:x1868674246995328:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 10092us (10313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.891698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 248 00000100:00100000:1.0:1782107200.896535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107200.896618:0:6517:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995456 00000100:00100000:2.0:1782107200.896629:0:6517:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995456 00000100:00100000:2.0:1782107200.896682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:2.0:1782107200.896692:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:36222:x1868674246995456:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1782107200.896744:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107200.896768:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43419600/0x7e3d6a8eb3a1342c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3f9d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.896836:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418e00/0x7e3d6a8eb3a13433 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.896850:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418e00/0x7e3d6a8eb3a13433 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.896860:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418e00/0x7e3d6a8eb3a13433 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107200.896942:0:6517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1782107200.896947:0:6517:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1782107200.896976:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43419600/0x7e3d6a8eb3a1342c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f9d expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.896991:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418e00/0x7e3d6a8eb3a13433 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3f9d expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.897000:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffffa08c7a609c00) 00010000:00010000:2.0:1782107200.897003:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1782107200.897006:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b43418e00, rc 0) 00000100:00100000:2.0:1782107200.897075:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246995456:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 385us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107200.897082:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 249 00000100:00100000:2.0:1782107200.901981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.904975:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995584 00000100:00100000:0.0:1782107200.904989:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995584 00000100:00100000:1.0:1782107200.905162:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:1.0:1782107200.905174:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246995584:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1782107200.905196:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107200.905216:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a1343a lrc: 2/0,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3fa4 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.905275:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb000/0x7e3d6a8eb3a13441 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.905291:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb000/0x7e3d6a8eb3a13441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.905301:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb000/0x7e3d6a8eb3a13441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107200.905348:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1782107200.905353:0:8982:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1782107200.905384:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a1343a lrc: 0/0,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fa4 expref: 10 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.905534:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb000/0x7e3d6a8eb3a13441 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fa4 expref: 9 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.905544:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffffa08c7a609200) 00010000:00010000:1.0:1782107200.905559:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782107200.905564:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412eb000, rc 0) 00000100:00100000:1.0:1782107200.905630:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:36222:x1868674246995584:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 458us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.905638:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 250 00000100:00100000:3.0:1782107200.910568:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107200.910858:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995712 00000100:00100000:2.0:1782107200.910899:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995712 00000100:00100000:2.0:1782107200.910955:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:2.0:1782107200.910966:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:36222:x1868674246995712:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1782107200.910986:0:7836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107200.911006:0:7836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419600/0x7e3d6a8eb3a13448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3fab expref: -99 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.911077:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.911093:0:7836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 6 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.911103:0:7836:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.911137:0:7836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 6 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.911152:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7836:1868674269183104:0@lo:104: 00000100:00100000:2.0:1782107200.911194:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107200.911236:0:7836:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c580e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1782107200.911454:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269183104 00000100:00100000:1.0:1782107200.911458:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269183104 00000100:00100000:1.0:1782107200.911485:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782107200.911513:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7836:x1868674269183104:12345-0@lo:104: 00010000:00010000:1.0:1782107200.911525:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.911586:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107200.911592:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7836:x1868674269183104:12345-0@lo:104: Request processed in 101us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.911599:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1782107200.911619:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107200.911625:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.911632:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907800 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:1.0:1782107200.911637:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107200.911644:0:6504:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.911665:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.911680:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782107200.911708:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.911715:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907800/0x7e3d6a8eb3a133f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a133fb expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107200.911728:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269183232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782107200.911732:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107200.911734:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107200.911735:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107200.911758:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107200.911892:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269183232 00000100:00100000:1.0:1782107200.911896:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269183232 00010000:00010000:1.0:1782107200.911913:0:9469:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 7 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107200.911940:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782107200.911947:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3659:x1868674269183232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782107200.911952:0:7836:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7836:1868674269183104:0@lo:104: 00010000:00010000:1.0:1782107200.911956:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782107200.911969:0:7836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.913133:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea200/0x7e3d6a8eb3a133fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7e3d6a8eb3a133f4 expref: 7 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.913150:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:1.0:1782107200.913155:0:9469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.913164:0:9469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.913188:0:9469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107200.913217:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107200.913277:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269183232:12345-0@lo:103:ldlm_bl.0 Request processed in 1330us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.913286:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1782107200.913363:0:7836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.913371:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107200.913450:0:7836:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1782107200.913455:0:7836:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782107200.913493:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419600/0x7e3d6a8eb3a13448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fab expref: 9 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.913507:0:7836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fab expref: 8 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107200.913514:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:3.0:1782107200.913516:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782107200.913519:0:7836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b43419200, rc 0) 00000100:00100000:3.0:1782107200.913565:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246995712:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2602us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.913572:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 251 00000100:00100000:2.0:1782107200.914340:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269183232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782107200.919003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107200.919224:0:6517:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246995840 00000100:00100000:2.0:1782107200.919234:0:6517:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246995840 00000100:00100000:2.0:1782107200.919295:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:2.0:1782107200.919305:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246995840:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1782107200.919339:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107200.919359:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a13456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3fb2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919468:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919482:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919493:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919508:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919521:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919579:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919587:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919592:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919599:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919612:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b43419800 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1782107200.919616:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919623:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919634:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:2.0:1782107200.919637:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107200.919642:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919648:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419800/0x7e3d6a8eb3a1345d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919668:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919674:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919679:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919684:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b43419a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1782107200.919687:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919693:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919712:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffffa08c43d2b400) 00010000:00010000:2.0:1782107200.919714:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107200.919717:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919722:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419a00/0x7e3d6a8eb3a13464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.919753:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a13456 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb2 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.920295:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:2.0:1782107200.920297:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107200.920303:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418800/0x7e3d6a8eb3a13456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb2 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.920313:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b43418800, rc 0) 00000100:00100000:2.0:1782107200.920476:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246995840:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1170us (1492us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107200.920484:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 252 00000100:00100000:1.0:1782107200.923596:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.923690:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246996096 00000100:00100000:0.0:1782107200.923711:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246996096 00000100:00100000:0.0:1782107200.923779:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:0.0:1782107200.923790:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:36222:x1868674246996096:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.923811:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.923814:0:8982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782107200.923839:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43419200/0x7e3d6a8eb3a1344f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fab expref: 8 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.923857:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c580d1e00) 00010000:00010000:0.0:1782107200.923867:0:8982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107200.923883:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1346b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3fb9 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924001:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924015:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924024:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924036:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924051:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924057:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924449:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924459:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924466:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107200.924476:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00010000:00010000:0.0:1782107200.924496:0:8982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924503:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924509:0:8982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924515:0:8982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924521:0:8982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b942c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107200.924525:0:8982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924531:0:8982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924539:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa08c447b8500) 00010000:00010000:0.0:1782107200.924541:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107200.924551:0:8982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 3/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924557:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13472 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107200.924568:0:8982:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ea029e40 reply state 000000006c7977ef transno 4294967389 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924578:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13479 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924584:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffffa08c447b8a00) 00010000:00010000:0.0:1782107200.924587:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107200.924589:0:8982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107200.924612:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a1346b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 10 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924626:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 9 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.924634:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:0.0:1782107200.924636:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107200.924638:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c40031800, rc 0) 00000100:00100000:0.0:1782107200.924685:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:36222:x1868674246996096:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 899us (1099us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1782107200.924692:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 253 00000100:00100000:3.0:1782107200.927817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.928022:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246996352 00000100:00100000:0.0:1782107200.928031:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246996352 00000100:00100000:0.0:1782107200.928101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:0.0:1782107200.928111:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:36222:x1868674246996352:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107200.928152:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107200.928175:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a1348e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b3fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.928278:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.928293:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 11 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.928301:0:6518:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.928333:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 11 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.928346:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 11 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107200.928359:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7b98f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1868674269183360:192.168.203.43@tcp:104: 00000100:00100000:0.0:1782107200.928454:0:6518:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b434c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1782107200.931060:0:6518:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7b98f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1868674269183360:192.168.203.43@tcp:104: 00010000:00010000:0.0:1782107200.931089:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107200.936089:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107200.936196:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246996480 00000100:00100000:0.0:1782107200.936206:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246996480 00010000:00010000:0.0:1782107200.936250:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 12 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107200.936305:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 86 00000100:00100000:0.0:1782107200.936316:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c796f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:2413:x1868674246996480:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782107200.936332:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107200.936339:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 12 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936352:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 12 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936387:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fb9 expref: 12 pid: 8982 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936438:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:0.0:1782107200.936444:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936453:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936461:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107200.936485:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107200.936552:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c796f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+11:2413:x1868674246996480:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 237us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.936559:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 86 00010000:00010000:2.0:1782107200.936656:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936664:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107200.936688:0:6518:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00010000:00010000:2.0:1782107200.936832:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936847:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936854:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936859:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c40030600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1782107200.936863:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936871:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936880:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:2.0:1782107200.936883:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782107200.936887:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936893:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13495 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936929:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a1348e lrc: 1/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fc0 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936939:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:2.0:1782107200.936941:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782107200.936944:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a1348e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b3fc0 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107200.936958:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c40031c00, rc 0) 00000100:00100000:2.0:1782107200.936993:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:36222:x1868674246996352:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 8885us (9186us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107200.937000:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 254 00000100:00100000:1.0:1782107200.940103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107200.940181:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674246996736 00000100:00100000:3.0:1782107200.940203:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674246996736 00000100:00100000:3.0:1782107200.940288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1782107200.940299:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:36222:x1868674246996736:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1782107200.940575:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:36222:x1868674246996736:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 278us (480us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782107200.940582:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00010000:00010000:2.0:1782107201.539530:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107201.987777:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107201.987807:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269183488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782107201.987882:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107201.987944:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269183488 00000100:00100000:3.0:1782107201.987952:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269183488 00000100:00100000:3.0:1782107201.987992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1782107201.988000:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3661:x1868674269183488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782107201.988031:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1782107201.988086:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:3661:x1868674269183488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107201.988093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1782107201.988136:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bbf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269183488:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1782107202.241493:0:22930:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_25a: @@@@@@ FAIL: setstripe EC failed 00010000:00010000:1.0:1782107202.563616:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1458 lines, 1458 kept, 0 dropped, 0 bad.