00010000:00010000:1.0F:1782107227.140606:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107227.588031:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107227.588051:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269206400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782107227.588114:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1782107227.588213:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269206400 00000100:00100000:2.0:1782107227.588227:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269206400 00000100:00100000:2.0:1782107227.588274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1782107227.588283:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269206400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782107227.588315:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446281216 avail 1300041728 00000100:00100000:2.0:1782107227.588361:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269206400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107227.588368:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1782107227.588465:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269206400:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1782107227.591029:0:8393:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1782107227.591050:0:8393:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000020:00080000:1.0:1782107227.591114:0:6495:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 9 batchid updated 00000001:00080000:1.0:1782107227.591134:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1782107227.591430:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000004:00080000:2.0:1782107227.591490:0:6548:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08c455436c0 with version 21 00000020:00080000:2.0:1782107227.591503:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 9 cancel update log [0x240000401:0x3:0x0].9: rc = 0 00000020:00080000:2.0:1782107227.591584:0:6548:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 9 cancel update log [0x200000400:0x3:0x0].9: rc = 0 00000020:00080000:2.0:1782107227.591591:0:6548:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000004:00080000:0.0F:1782107227.593453:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 21 rpc_version 21 00000020:00100000:0.0:1782107227.593501:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107227.593512:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c81ae3b80 x1868674269206656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107227.593544:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c81ae3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269206656:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782107227.593614:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107227.593650:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b42fc5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782107227.593767:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269206656 00000100:00100000:1.0:1782107227.593775:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269206656 00000100:00100000:1.0:1782107227.597940:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1782107227.597958:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7a5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7831:x1868674269206656:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782107227.598148:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7a5f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7831:x1868674269206656:12345-0@lo:1000:osp_up1-0.0 Request processed in 196us (4533us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1782107227.598156:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1782107227.601183:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c81ae3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269206656:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1782107228.164585:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107228.295486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0F:1782107228.295542:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247028992 00000100:00100000:3.0:1782107228.295565:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247028992 00000100:00080000:1.0:1782107228.295666:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782107228.295995:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 356 00000100:00100000:3.0:1782107228.296006:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+13:38492:x1868674247028992:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:3.0:1782107228.296038:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107228.296060:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b41e9 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296121:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296135:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296160:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107228.296242:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1782107228.296247:0:8982:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1782107228.296264:0:8982:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296285:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906000/0x7e3d6a8eb3a13cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41e9 expref: 15 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296302:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41e9 expref: 14 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.296309:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c51e1fc00) 00010000:00010000:3.0:1782107228.296312:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782107228.296316:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907400, rc 0) 00000100:00100000:3.0:1782107228.296384:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:38492:x1868674247028992:12345-192.168.203.43@tcp:101:rm.0 Request processed in 381us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107228.296391:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 356 00000100:00100000:1.0:1782107228.323700:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107228.323772:0:6516:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029120 00000100:00100000:0.0:1782107228.323782:0:6516:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029120 00000100:00100000:0.0:1782107228.323837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 357 00000100:00100000:0.0:1782107228.323857:0:6516:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:38492:x1868674247029120:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1782107228.323877:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107228.323906:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13cd7 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b41f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.323971:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13cde lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.323992:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13cde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.324009:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13cde lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107228.324186:0:6516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1782107228.324191:0:6516:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1782107228.324241:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13cd7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f0 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.324265:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13cde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f0 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.324328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffffa08c447b8500) 00010000:00010000:0.0:1782107228.324331:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782107228.324335:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942c00, rc 0) 00000100:00100000:0.0:1782107228.328180:0:6516:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247029120:12345-192.168.203.43@tcp:101:rm.0 Request processed in 4316us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107228.328191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 357 00000100:00100000:1.0:1782107228.334385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107228.335990:0:6520:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029248 00000100:00100000:2.0:1782107228.336006:0:6520:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029248 00000100:00100000:2.0:1782107228.336058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:2.0:1782107228.336069:0:6520:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247029248:12345-192.168.203.43@tcp:37:rm.0 00000100:00100000:2.0:1782107228.341131:0:6520:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247029248:12345-192.168.203.43@tcp:37:rm.0 Request processed in 5054us (6741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.341144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1782107228.350020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107228.350813:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029376 00000100:00100000:0.0:1782107228.350825:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029376 00000100:00100000:0.0:1782107228.350919:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:0.0:1782107228.350931:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:38492:x1868674247029376:12345-192.168.203.43@tcp:37:rm.0 00000100:00080000:2.0:1782107228.351451:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107228.356968:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:38492:x1868674247029376:12345-192.168.203.43@tcp:37:rm.0 Request processed in 6031us (6947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107228.356982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1782107228.363216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107228.363295:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029504 00000100:00100000:0.0:1782107228.363304:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029504 00000100:00100000:0.0:1782107228.363361:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 358 00000100:00100000:0.0:1782107228.363372:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:38492:x1868674247029504:12345-192.168.203.43@tcp:41:rm.0 00000004:00000024:0.0:1782107228.363448:0:18105:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7844962304 avail 7380295680 00000100:00100000:0.0:1782107228.363515:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:38492:x1868674247029504:12345-192.168.203.43@tcp:41:rm.0 Request processed in 145us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107228.363522:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 358 00000100:00100000:1.0:1782107228.373915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107228.375223:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029632 00000100:00100000:0.0:1782107228.375236:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029632 00000100:00100000:0.0:1782107228.375300:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 359 00000100:00100000:0.0:1782107228.375311:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247029632:12345-192.168.203.43@tcp:101:rm.0 00010000:00010000:0.0:1782107228.375339:0:7836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107228.375358:0:7836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13ce5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b41f7 expref: -99 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375444:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/1,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375459:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375471:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375485:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375492:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375498:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375577:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375586:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375593:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107228.375630:0:7836:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0xa:0x0]: returning size 3145729 00000004:00200000:0.0:1782107228.375640:0:7836:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782107228.375661:0:7836:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375685:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375694:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375700:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 2/0,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375707:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375713:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b942000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107228.375717:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375724:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375735:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffffa08c447b8500) 00010000:00010000:0.0:1782107228.375738:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107228.375742:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 2/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375748:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13cec lrc: 0/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375760:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375775:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375781:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375787:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b943000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107228.375790:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375796:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375805:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0xc0870d27 (ffffa08c447b8800) 00010000:00010000:0.0:1782107228.375807:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107228.375810:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375815:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13cf3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375857:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13ce5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f7 expref: 17 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375872:0:7836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f7 expref: 16 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.375879:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:0.0:1782107228.375881:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107228.375889:0:7836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942800, rc 0) 00000100:00100000:0.0:1782107228.375957:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:38492:x1868674247029632:12345-192.168.203.43@tcp:101:rm.0 Request processed in 647us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107228.375965:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 359 00000100:00100000:0.0:1782107228.389809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107228.389885:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247029888 00000100:00100000:1.0:1782107228.389896:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247029888 00000100:00100000:1.0:1782107228.389954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 360 00000100:00100000:1.0:1782107228.389963:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:38492:x1868674247029888:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:1.0:1782107228.390018:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782107228.390043:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13cfa lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f7 expref: 16 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390080:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13c21 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41b8 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390092:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffffa08c447b8f00) 00010000:00010000:1.0:1782107228.390106:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13cde lrc: 0/0,0 mode: --/PR res: [0x240000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41f0 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390115:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffffa08c447b8500) 00010000:00010000:1.0:1782107228.390122:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782107228.390144:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390156:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390164:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390175:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390181:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390188:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390257:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390274:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.390282:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782107228.390946:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8760 00000004:00080000:1.0:1782107228.390958:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 664834556670ns, next at 665834553420ns, rc = 0 00000040:00080000:1.0:1782107228.390980:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8760 00000004:00080000:1.0:1782107228.390985:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 664834584375ns, next at 665834582795ns, rc = 0 00000040:00080000:1.0:1782107228.390996:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00000040:00080000:1.0:1782107228.391003:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00010000:00010000:1.0:1782107228.391118:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391127:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391136:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391143:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391149:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391155:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391173:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782107228.391205:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391211:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391217:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391222:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412ea400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1782107228.391226:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391234:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391245:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffffa08c580d1100) 00010000:00010000:1.0:1782107228.391248:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782107228.391252:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391259:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea400/0x7e3d6a8eb3a13d0f lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391277:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391282:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391287:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391293:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391304:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412eac00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1782107228.391307:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391313:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391321:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffffa08c580d1200) 00010000:00010000:1.0:1782107228.391324:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107228.391327:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391333:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eac00/0x7e3d6a8eb3a13d01 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107228.391347:0:6518:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000094cfb3c4 reply state 00000000873c0fc5 transno 4294967383 ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391363:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0xc0870d27 (ffffa08c580d1700) 00010000:00010000:1.0:1782107228.391365:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782107228.391368:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782107228.391468:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247029888:12345-192.168.203.43@tcp:36:rm.0 Request processed in 1503us (1665us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1782107228.391475:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 360 00010000:00010000:1.0:1782107228.391501:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107228.391507:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391524:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412ea800 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:1.0:1782107228.391527:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391533:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391541:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa:0x0].0x0 (ffffa08c580d1100) 00010000:00010000:1.0:1782107228.391544:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782107228.391547:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 1/0,0 mode: --/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.391553:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d16 lrc: 0/0,0 mode: --/PW res: [0x240000402:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.393701:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107228.393708:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107228.393710:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107228.397384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107228.397476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107228.397553:0:6520:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030272 00000100:00100000:2.0:1782107228.397573:0:6520:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030272 00000100:00100000:2.0:1782107228.397628:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 73 00000100:00100000:2.0:1782107228.397639:0:6520:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c5115a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+15:38492:x1868674247030272:12345-192.168.203.43@tcp:35:rm.0 00000040:00080000:2.0:1782107228.397925:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].10, 344 off47616 00000040:00080000:2.0:1782107228.397989:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].10, 424 off49016 00000004:00080000:2.0:1782107228.397995:0:6520:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08b43591180 with version 22 00000100:00100000:2.0:1782107228.398017:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030016 00000100:00100000:2.0:1782107228.398021:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030016 00000100:00100000:2.0:1782107228.398056:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1782107228.398063:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:2413:x1868674247030016:12345-192.168.203.43@tcp:103:rm.0 00010000:00010000:2.0:1782107228.398075:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107228.398097:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b43418200/0x7e3d6a8eb3a138cb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40c3 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.398114:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c51e1f600) 00010000:00010000:2.0:1782107228.398125:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107228.398174:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:2413:x1868674247030016:12345-192.168.203.43@tcp:103:rm.0 Request processed in 111us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.398182:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000004:00080000:2.0:1782107228.398201:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 22 rpc_version 22 00000020:00100000:2.0:1782107228.398225:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782107228.398235:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b4354f100 x1868674269206912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782107228.398257:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269206912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782107228.398301:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.398349:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b43591cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.398370:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269206912 00000100:00100000:2.0:1782107228.398374:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269206912 00000100:00100000:2.0:1782107228.398425:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1782107228.398432:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c46d72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7445:x1868674269206912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782107228.398565:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c46d72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7445:x1868674269206912:12345-0@lo:1000:osp_up0-1.0 Request processed in 133us (263us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782107228.398577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1782107228.398742:0:7445:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967411 gen 2 00000004:00080000:2.0:1782107228.398747:0:7445:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967411 committed transno 4294967411 00000100:00100000:2.0:1782107228.398764:0:7445:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffffa08b4354f100 x1868674269206912/t4294967412(4294967412) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 1782107244 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107228.398783:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269206912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782107228.398861:0:6520:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c5115a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+16:38492:x1868674247030272:12345-192.168.203.43@tcp:35:rm.0 Request processed in 1224us (1485us total) trans 4294967384 rc 0/0 00000100:00100000:2.0:1782107228.398867:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 73 00000001:00080000:0.0:1782107228.400169:0:7431:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967383 is committed 00000004:00080000:0.0:1782107228.400177:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 7 committed 00000004:00080000:0.0:1782107228.400191:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 7 committed 00000001:00080000:0.0:1782107228.400199:0:7431:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967382 is committed 00000100:00100000:3.0:1782107228.400309:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782107228.400322:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269207040:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1782107228.400362:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.400420:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207040 00000100:00100000:3.0:1782107228.400425:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207040 00000100:00100000:3.0:1782107228.400462:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782107228.400469:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3659:x1868674269207040:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1782107228.400489:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:3 count 1 00002000:00010000:3.0:1782107228.400515:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 3145728, mtime: 0x6a38cc56, atime: 0x0, ctime: 0x6a38cc56, blocks: 0x800 00010000:00010000:3.0:1782107228.400522:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400536:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107228.400539:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107228.400544:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400557:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400580:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400600:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400616:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782107228.400721:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3659:x1868674269207040:12345-0@lo:6:osp-syn-1-1.0 Request processed in 252us (358us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782107228.400728:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1782107228.400747:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107228.400753:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400761:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906000 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:3.0:1782107228.400765:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400774:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400788:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400795:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e341fa/0x7e3d6a8eb3a13d1d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.400810:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107228.400816:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107228.400817:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782107228.400993:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa08b41f56a00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1782107228.401002:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269207040:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1782107228.401550:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401717:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401724:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401730:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412ebe00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:2.0:1782107228.401734:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401740:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401752:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0xc0870d27 (ffffa08c580d1700) 00010000:00010000:2.0:1782107228.401755:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107228.401759:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.401771:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebe00/0x7e3d6a8eb3a13d08 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x8:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782107228.401864:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107228.401870:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107228.401879:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269207168:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1782107228.401917:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.401951:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207168 00000100:00100000:2.0:1782107228.401956:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207168 00000100:00100000:2.0:1782107228.401989:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782107228.401996:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269207168:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1782107228.402013:0:8397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1782107228.402034:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 524288, mtime: 0x6a38cc55, atime: 0x6a38cc55, ctime: 0x6a38cc56, blocks: 0x400 00010000:00010000:2.0:1782107228.402040:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402051:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1782107228.402053:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1782107228.402056:0:8397:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402067:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402074:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402090:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402103:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782107228.402206:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269207168:12345-0@lo:6:osp-syn-0-1.0 Request processed in 211us (288us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782107228.402212:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1782107228.402233:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107228.402237:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402246:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b43418000 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:2.0:1782107228.402249:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402256:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402266:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402273:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a832efa/0x7e3d6a8eb3a13d24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.402285:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107228.402293:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107228.402295:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782107228.402300:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107228.402321:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1782107228.402326:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c81b0aa00, transno 4294967305 00000004:00080000:2.0:1782107228.402332:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c7ba2c380, transno 4294967307 00000004:00080000:2.0:1782107228.402335:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c7a522a00, transno 4294967308 00000004:00080000:2.0:1782107228.402337:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c7a521c00, transno 4294967309 00000100:00100000:2.0:1782107228.402343:0:3658:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffffa08b4354d180 x1868674269207168/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782107244 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1782107228.402351:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa08b4354d180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782107228.402355:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269207168:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1782107228.402447:0:8502:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 4 done 00000001:00080000:0.0:1782107228.406864:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1782107228.406882:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1782107228.412927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107228.424616:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030528 00000100:00100000:0.0:1782107228.424627:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030528 00000100:00100000:0.0:1782107228.424694:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 361 00000100:00100000:0.0:1782107228.424705:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:38492:x1868674247030528:12345-192.168.203.43@tcp:36:rm.0 00010000:00010000:0.0:1782107228.424763:0:18105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782107228.424791:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b43418c00/0x7e3d6a8eb3a1399d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4109 expref: 9 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.424810:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907400/0x7e3d6a8eb3a13cd0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41e9 expref: 8 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.424822:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eaa00/0x7e3d6a8eb3a138d9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40ca expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.424833:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c51e1fc00) 00010000:00010000:0.0:1782107228.424852:0:18105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107228.424898:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.424915:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.424926:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107228.424947:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41566d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207296:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1782107228.425029:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107228.425084:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b42fc5780 going to sleep for 11 seconds 00000100:00100000:1.0:1782107228.429295:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207296 00000100:00100000:1.0:1782107228.429308:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207296 00000100:00100000:1.0:1782107228.429374:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1782107228.429384:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:18105:x1868674269207296:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1782107228.429424:0:7835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107228.429445:0:7835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13d2b expref: -99 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.429474:0:7835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.429502:0:7835:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.429546:0:7835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.429742:0:7835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 6 pid: 6518 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107228.429758:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7835:1868674269207424:192.168.203.43@tcp:104: 00000100:00100000:1.0:1782107228.429858:0:7835:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c580e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.451232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107228.451263:0:9470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030656 00000100:00100000:2.0:1782107228.451271:0:9470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030656 00010000:00010000:2.0:1782107228.451308:0:9470:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 7 pid: 6518 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107228.451341:0:9470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 108 00000100:00100000:2.0:1782107228.451351:0:9470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:2411:x1868674247030656:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782107228.451364:0:9470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107228.451371:0:9470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 7 pid: 6518 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451383:0:9470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 7 pid: 6518 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451436:0:9470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:2.0:1782107228.451443:0:9470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451453:0:9470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451462:0:9470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451497:0:9470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107228.451511:0:9470:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9470:1868674269207552:0@lo:105: 00000100:00100000:2.0:1782107228.451572:0:9470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.451605:0:9470:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.451634:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782107228.451643:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207552 00000100:00100000:2.0:1782107228.451647:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207552 00000100:00100000:2.0:1782107228.451672:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782107228.451679:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fc93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9470:x1868674269207552:12345-0@lo:105: 00010000:00010000:2.0:1782107228.451689:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451698:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451716:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451722:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451729:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451736:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.451749:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffffa08c7b943000) 00000100:00100000:2.0:1782107228.451782:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fc93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9470:x1868674269207552:12345-0@lo:105: Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.451789:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782107228.451856:0:9470:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:9470:1868674269207552:0@lo:105: 00010000:00010000:2.0:1782107228.451870:0:9470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107228.451906:0:9470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:2411:x1868674247030656:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 556us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.451913:0:9470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 108 00010000:00010000:1.0:1782107228.454198:0:7835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907000/0x7e3d6a8eb3a138af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40bc expref: 6 pid: 6518 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107228.454222:0:7835:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7835:1868674269207424:192.168.203.43@tcp:104: 00010000:00010000:1.0:1782107228.454251:0:7835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 8 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.454262:0:7835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:1.0:1782107228.454265:0:7835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107228.454268:0:7835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412ea800, rc 0) 00000100:00100000:1.0:1782107228.454345:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269207296:12345-0@lo:101:mdt00_005.0 Request processed in 24962us (29315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107228.454353:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1782107228.454736:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41566d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207296:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.454752:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782107228.454773:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782107228.454813:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.454820:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.454829:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.454870:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207680:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782107228.454908:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.455721:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1782107228.455746:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207680 00000100:00100000:3.0:1782107228.455752:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207680 00000100:00100000:3.0:1782107228.455797:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1782107228.455805:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:18105:x1868674269207680:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.455822:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107228.455837:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13d40 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13d39 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.455893:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13d40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d39 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.455906:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13d40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d39 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.455914:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffffa08c4380f200) 00010000:00010000:3.0:1782107228.455916:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107228.455919:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907600, rc 0) 00000100:00100000:3.0:1782107228.455962:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269207680:12345-0@lo:101:mdt00_005.0 Request processed in 157us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107228.455968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1782107228.456001:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207680:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.456013:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.456023:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782107228.456040:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1782107228.456075:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207808:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107228.456105:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.456122:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435d1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782107228.456484:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207808 00000100:00100000:1.0:1782107228.456496:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207808 00000100:00100000:1.0:1782107228.456526:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1782107228.456533:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269207808:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1782107228.456717:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269207808:12345-0@lo:1000:mdt00_005.0 Request processed in 184us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107228.456724:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1782107228.459372:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207808:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107228.459468:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207936:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782107228.459529:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.459557:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c412ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.459823:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269207936 00000100:00100000:2.0:1782107228.459830:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269207936 00000100:00100000:2.0:1782107228.459896:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1782107228.459905:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269207936:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782107228.460002:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269207936:12345-0@lo:1000:mdt00_005.0 Request processed in 97us (472us total) trans 0 rc 1/1 00000100:00100000:2.0:1782107228.460017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1782107228.462781:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269207936:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1782107228.462883:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.462895:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.462904:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.462922:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208064:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782107228.462974:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.463003:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1782107228.463023:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208064 00000100:00100000:3.0:1782107228.463029:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208064 00000100:00100000:3.0:1782107228.463074:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1782107228.463081:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:18105:x1868674269208064:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.463098:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107228.463112:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a13d4e lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13d47 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463139:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a13d4e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d47 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463151:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a13d4e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d47 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463173:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c4380fb00) 00010000:00010000:3.0:1782107228.463176:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782107228.463180:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907c00, rc 0) 00000100:00100000:3.0:1782107228.463216:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:18105:x1868674269208064:12345-0@lo:101:mdt00_005.0 Request processed in 135us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107228.463224:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1782107228.463254:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208064:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.463266:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463275:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463296:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463303:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463309:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463325:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,1 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463331:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463336:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463361:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463367:0:18105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463373:0:18105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.463384:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208192:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782107228.463431:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.463445:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1782107228.463456:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208192 00000100:00100000:3.0:1782107228.463459:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208192 00000100:00100000:3.0:1782107228.463479:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1782107228.463485:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:18105:x1868674269208192:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782107228.463492:0:7835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107228.463501:0:7835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13d63 expref: -99 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463518:0:7835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 5 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463526:0:7835:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 4/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 11 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463548:0:7835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 5 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.463889:0:7835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 5 pid: 7836 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.463901:0:7835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7835:1868674269208320:192.168.203.43@tcp:104: 00000100:00100000:3.0:1782107228.463966:0:7835:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782107228.474889:0:7835:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7835:1868674269208320:192.168.203.43@tcp:104: 00010000:00010000:3.0:1782107228.474926:0:7835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 3/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 11 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.474939:0:7835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffffa08c43da2600) 00010000:00010000:3.0:1782107228.474942:0:7835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782107228.474946:0:7835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 3/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 11 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.474957:0:7835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 3/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 11 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.474964:0:7835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907800, rc 0) 00000100:00100000:3.0:1782107228.475031:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:18105:x1868674269208192:12345-0@lo:101:mdt00_005.0 Request processed in 11545us (11598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107228.475039:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1782107228.476791:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208192:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1782107228.476812:0:18105:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.476824:0:18105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.478919:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107228.479120:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030784 00000100:00100000:2.0:1782107228.479129:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030784 00010000:00010000:2.0:1782107228.479167:0:9469:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 6 pid: 7836 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107228.479200:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 109 00000100:00100000:2.0:1782107228.479210:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2413:x1868674247030784:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782107228.479223:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107228.479229:0:9469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 6 pid: 7836 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479242:0:9469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 6 pid: 7836 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479264:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906400/0x7e3d6a8eb3a138f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b40d8 expref: 6 pid: 7836 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479281:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffffa08c43da2600) 00010000:00010000:2.0:1782107228.479297:0:9469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479307:0:9469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479316:0:9469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479348:0:9469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107228.479364:0:9469:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9469:1868674269208448:0@lo:105: 00000100:00100000:2.0:1782107228.479428:0:9469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.479460:0:9469:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.479475:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208448 00000100:00100000:2.0:1782107228.479478:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208448 00000100:00100000:2.0:1782107228.479504:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782107228.479511:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9469:x1868674269208448:12345-0@lo:105: 00010000:00010000:2.0:1782107228.479520:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479530:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479538:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479546:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479568:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479578:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479596:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffffa08b42907400) 00000100:00100000:2.0:1782107228.479632:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9469:x1868674269208448:12345-0@lo:105: Request processed in 121us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.479639:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782107228.479680:0:9469:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9469:1868674269208448:0@lo:105: 00010000:00010000:2.0:1782107228.479693:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107228.479728:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247030784:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 519us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.479734:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 109 00010000:00010000:2.0:1782107228.479820:0:18105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107228.479829:0:18105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107228.480480:0:18105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208576:0@lo:403:mdt00_005.0 00000100:00100000:2.0:1782107228.480525:0:18105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.480546:0:18105:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782107228.480565:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208576 00000100:00100000:2.0:1782107228.480568:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208576 00000100:00100000:2.0:1782107228.480604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1782107228.480611:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b43507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:18105:x1868674269208576:12345-0@lo:403:mdt00_005.0 00000100:00100000:2.0:1782107228.482269:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b43507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:18105:x1868674269208576:12345-0@lo:403:mdt00_005.0 Request processed in 1651us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.482281:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1782107228.482342:0:18105:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18105:1868674269208576:0@lo:403:mdt00_005.0 00000040:00080000:3.0:1782107228.494139:0:18105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].11, 936 off48552 00000040:00080000:3.0:1782107228.494305:0:18105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].11, 1016 off50032 00000004:00080000:3.0:1782107228.494312:0:18105:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08b435d1c00 with version 23 00000004:00080000:2.0:1782107228.495765:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 23 rpc_version 23 00000020:00100000:2.0:1782107228.495808:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782107228.495819:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b4354d500 x1868674269208832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782107228.495855:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269208832:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782107228.495925:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.495963:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b435916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782107228.497515:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208832 00000100:00100000:3.0:1782107228.497527:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208832 00000100:00100000:3.0:1782107228.497596:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1782107228.497607:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7445:x1868674269208832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782107228.498155:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:7445:x1868674269208832:12345-0@lo:1000:osp_up0-1.0 Request processed in 550us (2229us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1782107228.498164:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1782107228.498338:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269208832:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1782107228.498514:0:18105:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 4096 00010000:00010000:3.0:1782107228.498721:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498732:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498740:0:18105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498746:0:18105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107228.498750:0:18105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498758:0:18105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498772:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x8:0x0].0x0 (ffffa08c4380fe00) 00010000:00010000:3.0:1782107228.498775:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782107228.498780:0:18105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 2/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498786:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d5c lrc: 0/0,0 mode: --/EX res: [0x240000400:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498817:0:18105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498825:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.498831:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499282:0:18105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782107228.499291:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x8:0x0] 00010000:00010000:3.0:1782107228.499300:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499307:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499313:0:18105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499318:0:18105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906800 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107228.499322:0:18105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499328:0:18105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499337:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c4380f600) 00010000:00010000:3.0:1782107228.499340:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107228.499350:0:18105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499356:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13d55 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18105 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499370:0:18105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499378:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.499385:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.499924:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782107228.499931:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.499940:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907400 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:0.0:1782107228.499944:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107228.499952:0:6505:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.499989:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.499996:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782107228.500056:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782107228.500078:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.500097:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42907400/0x7e3d6a8eb3a13d63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d6a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.500110:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782107228.500113:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.500119:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906e00 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:0.0:1782107228.500123:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107228.500130:0:6505:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 5/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.500149:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 4/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.500154:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107228.500213:0:18105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:3.0:1782107228.500226:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782107228.500230:0:18105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.500237:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.500243:0:18105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.500251:0:18105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782107228.500254:0:18105:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782107228.500258:0:18105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.500276:0:18105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107228.500351:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:38492:x1868674247030528:12345-192.168.203.43@tcp:36:rm.0 Request processed in 75645us (87431us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1782107228.500359:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 361 00000100:00100000:1.0:1782107228.500496:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107228.500511:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269209088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782107228.500578:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107228.501041:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209088 00000100:00100000:3.0:1782107228.501048:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209088 00000100:00100000:3.0:1782107228.501100:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782107228.501110:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c796f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3660:x1868674269209088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782107228.501121:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782107228.501140:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907c00/0x7e3d6a8eb3a13d4e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d47 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107228.501152:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffffa08c4380fb00) 00010000:00010000:3.0:1782107228.501160:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782107228.501195:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c796f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3660:x1868674269209088:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107228.501202:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782107228.501253:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269209088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782107228.501342:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269208960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782107228.501372:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782107228.501422:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107228.502291:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107228.502294:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107228.502295:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107228.502320:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502330:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b943000 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:1.0:1782107228.502336:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107228.502344:0:6504:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502370:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502376:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782107228.502417:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502425:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08c7b943000/0x7e3d6a8eb3a13d2b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d32 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502445:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107228.502446:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107228.502448:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107228.502487:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269209216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782107228.502517:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107228.502801:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269208960 00000100:00100000:1.0:1782107228.502806:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269208960 00000100:00100000:1.0:1782107228.502853:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209216 00000100:00100000:1.0:1782107228.502857:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209216 00000100:00100000:1.0:1782107228.502878:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782107228.502884:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3661:x1868674269208960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782107228.502893:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107228.502907:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907800/0x7e3d6a8eb3a13d6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d63 expref: 12 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.502918:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffffa08c43da2600) 00010000:00010000:1.0:1782107228.502926:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107228.502958:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3661:x1868674269208960:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107228.502965:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782107228.502978:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782107228.502984:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3658:x1868674269209216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782107228.502991:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107228.503001:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea800/0x7e3d6a8eb3a13d32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d2b expref: 10 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107228.503010:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:1.0:1782107228.503013:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107228.503047:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3658:x1868674269209216:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107228.503053:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782107228.503084:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269208960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782107228.503107:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269209216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782107228.503511:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.503520:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906e00/0x7e3d6a8eb3a13d47 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d4e expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107228.503534:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107228.503536:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107228.503538:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107229.188630:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107229.639864:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782107229.639890:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7b98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269209344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782107229.639965:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107229.648785:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209344 00000100:00100000:2.0:1782107229.648798:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209344 00000100:00100000:2.0:1782107229.648878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1782107229.648890:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3658:x1868674269209344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782107229.648938:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1782107229.649021:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3658:x1868674269209344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (9055us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107229.649030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1782107229.649201:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7b98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269209344:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1782107230.138231:0:23867:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 01:47:08 (1782107228) 00000100:00100000:0.0:1782107230.147602:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107230.147634:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269209472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107230.147699:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107230.147883:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209472 00000100:00100000:2.0:1782107230.147892:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209472 00000100:00100000:2.0:1782107230.148027:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782107230.148037:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7587ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269209472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107230.148067:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107230.148110:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7587ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269209472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107230.148118:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:0.0:1782107230.148564:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107230.148601:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269209472:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1782107230.163994:0:8503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 666607590679ns, next at 667607588071ns, rc = 0 00000100:00100000:0.0:1782107230.164141:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269209600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782107230.164207:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.164293:0:8402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209600 00000100:00100000:0.0:1782107230.164309:0:8402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209600 00000100:00100000:0.0:1782107230.164372:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1782107230.164382:0:8402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269209600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782107230.164424:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782107230.164466:0:8402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269209600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.164473:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:0.0:1782107230.164494:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107230.164524:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269209600:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782107230.218195:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107230.489147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107230.489303:0:6511:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247030912 00000100:00100000:2.0:1782107230.489313:0:6511:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247030912 00000100:00100000:2.0:1782107230.489371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 447 00000100:00100000:2.0:1782107230.489387:0:6511:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c48e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2414:x1868674247030912:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1782107230.489901:0:6511:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c48e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2414:x1868674247030912:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 515us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.489910:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 447 00000100:00100000:2.0:1782107230.493367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107230.493487:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031040 00000100:00100000:0.0:1782107230.493497:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031040 00000100:00100000:0.0:1782107230.493573:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 701 00000100:00100000:0.0:1782107230.493583:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247031040:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1782107230.493662:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247031040:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.493668:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 701 00000100:00080000:2.0:1782107230.493921:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107230.506932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107230.506970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107230.507006:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031296 00000100:00100000:3.0:1782107230.507017:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031296 00000100:00100000:2.0:1782107230.507019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107230.507135:0:6516:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031168 00000100:00100000:0.0:1782107230.507139:0:6516:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031168 00000100:00100000:0.0:1782107230.507178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 702 00000100:00100000:0.0:1782107230.507189:0:6516:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:2411:x1868674247031168:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1782107230.507268:0:6516:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:2411:x1868674247031168:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.507275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 702 00000100:00080000:2.0:1782107230.508608:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782107230.508618:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107230.509949:0:10279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031424 00000100:00100000:1.0:1782107230.509964:0:10279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031424 00000100:00100000:1.0:1782107230.510078:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:1.0:1782107230.510093:0:10279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2411:x1868674247031296:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107230.510200:0:10279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7b98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2411:x1868674247031296:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 114us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107230.510207:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 193 00000100:00100000:1.0:1782107230.510224:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00100000:1.0:1782107230.510230:0:10279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c81adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2411:x1868674247031424:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107230.510254:0:10279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c81adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2411:x1868674247031424:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107230.510260:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 194 00000100:00080000:2.0:1782107230.512393:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107230.661139:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107230.661160:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269209728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107230.661228:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107230.661309:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209728 00000100:00100000:1.0:1782107230.661317:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209728 00000100:00100000:1.0:1782107230.661369:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1782107230.661378:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269209728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107230.661436:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923005440 avail 3691483136 00000100:00100000:1.0:1782107230.661477:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269209728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107230.661484:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:3.0:1782107230.661875:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782107230.662382:0:9882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 667105980041ns, next at 668105977836ns, rc = 0 00000100:00100000:0.0:1782107230.662450:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269209856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782107230.662489:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.662543:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269209728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107230.662572:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209856 00000100:00100000:0.0:1782107230.662576:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209856 00000100:00100000:0.0:1782107230.662611:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782107230.662618:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269209856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782107230.662632:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923005440 avail 3691483136 00000100:00100000:0.0:1782107230.662666:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269209856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.662672:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1782107230.662699:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1782107230.662705:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c4abbd500, transno 4294967303 00000004:00080000:0.0:1782107230.662711:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c4abbdc00, transno 4294967304 00000004:00080000:0.0:1782107230.662714:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c4abbfb80, transno 4294967305 00000004:00080000:0.0:1782107230.662717:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08b41f56a00, transno 4294967307 00000100:00100000:0.0:1782107230.662724:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269209856:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1782107230.663805:0:9881:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 4 done 00000100:00080000:3.0:1782107230.663842:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107230.667920:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107230.667948:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269210240:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668019:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.668092:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269210368:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668117:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.668151:0:6517:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210368 00000100:00100000:0.0:1782107230.668158:0:6517:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210368 00000100:00100000:0.0:1782107230.668196:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1782107230.668206:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4155dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269210368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668253:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4155dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269210368:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.668260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1782107230.668298:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269210368:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668337:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107230.668343:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269210752:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668364:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.668385:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210752 00000100:00100000:0.0:1782107230.668388:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210752 00000100:00100000:0.0:1782107230.668455:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1782107230.668461:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269210752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.668493:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269210752:12345-0@lo:400:kworker.0 Request processed in 32us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.668499:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1782107230.668521:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269210752:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.668686:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269209984:0@lo:400:kworker.0 00000100:00100000:2.0:1782107230.668691:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1868674269210112:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.668726:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107230.668743:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107230.668759:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269210496:0@lo:400:kworker.0 00000100:00100000:2.0:1782107230.668771:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1868674269210624:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.668788:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107230.668801:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107230.668835:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210112 00000100:00100000:3.0:1782107230.668840:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210112 00000100:00100000:2.0:1782107230.668852:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210240 00000100:00100000:2.0:1782107230.668857:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210240 00000100:00100000:3.0:1782107230.668868:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210624 00000100:00100000:3.0:1782107230.668872:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210624 00000100:00100000:2.0:1782107230.668902:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210496 00000100:00100000:2.0:1782107230.668906:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210496 00000100:00100000:3.0:1782107230.668917:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1782107230.668928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1782107230.668936:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3659:x1868674269210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107230.669492:0:6510:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269209984 00000100:00100000:1.0:1782107230.669497:0:6510:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269209984 00000100:00100000:1.0:1782107230.669527:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1782107230.669534:0:6510:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c51144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269209984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107230.669577:0:6510:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c51144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269209984:12345-0@lo:400:kworker.0 Request processed in 44us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107230.669583:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1782107230.669646:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c60851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1868674269210112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.669686:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c60851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1868674269210112:12345-0@lo:400:kworker.0 Request processed in 763us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107230.669692:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1782107230.669707:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782107230.669714:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c60851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1868674269210624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.669736:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c60851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1868674269210624:12345-0@lo:400:kworker.0 Request processed in 24us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107230.669742:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782107230.669770:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269209984:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.669807:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1782107230.669814:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269210496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.669859:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269210496:12345-0@lo:400:kworker.0 Request processed in 46us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107230.669865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1782107230.671188:0:3660:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967382 gen 2 00000004:00080000:3.0:1782107230.671197:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967382 committed transno 4294967382 00000100:00100000:3.0:1782107230.671218:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269210496:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.671273:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1868674269210112:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.671285:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1868674269210624:0@lo:400:kworker.0 00000100:00080000:3.0:1782107230.671427:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107230.671431:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782107230.671444:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107230.671455:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269210880:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.671500:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107230.671537:0:10279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269210880 00000100:00100000:3.0:1782107230.671541:0:10279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269210880 00000100:00100000:2.0:1782107230.674148:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3659:x1868674269210240:12345-0@lo:400:kworker.0 Request processed in 5205us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107230.674163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1782107230.677330:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269211008:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.677396:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107230.677628:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269210240:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.679610:0:10279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211008 00000100:00100000:3.0:1782107230.679623:0:10279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211008 00000100:00100000:0.0:1782107230.679641:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782107230.679655:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269210880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.679677:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1782107230.679687:0:10279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269211008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.679731:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269210880:12345-0@lo:400:kworker.0 Request processed in 80us (8230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.679739:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782107230.679745:0:10279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269211008:12345-0@lo:400:kworker.0 Request processed in 60us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107230.679753:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782107230.679784:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269211008:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.679849:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107230.679857:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269211136:0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.679889:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107230.679920:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211136 00000100:00100000:0.0:1782107230.679924:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211136 00000100:00100000:0.0:1782107230.679972:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1782107230.679980:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269211136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107230.680016:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269211136:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107230.680022:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1782107230.680047:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269211136:0@lo:400:kworker.0 00000100:00080000:3.0:1782107230.680152:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107230.681649:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1868674269211264:0@lo:400:kworker.0 00000100:00100000:2.0:1782107230.685258:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107230.685336:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269210880:0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.685466:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211264 00000100:00100000:3.0:1782107230.685473:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211264 00000100:00100000:3.0:1782107230.685552:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1782107230.685563:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c60852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1868674269211264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107230.685629:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c60852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1868674269211264:12345-0@lo:400:kworker.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107230.685635:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1782107230.685711:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1868674269211264:0@lo:400:kworker.0 00000100:00080000:2.0:1782107230.687100:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782107231.250612:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107231.701342:0:23917:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00010000:00010000:2.0:1782107232.260205:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107232.707790:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107232.707846:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269211392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782107232.708012:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107232.708239:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211392 00000100:00100000:3.0:1782107232.708246:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211392 00000100:00100000:3.0:1782107232.708334:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1782107232.708343:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269211392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782107232.708377:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1782107232.708465:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269211392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107232.708472:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1782107232.708546:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269211392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782107233.284276:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782107233.735439:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:02000400:0.0:1782107234.002227:0:23965:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 01:47:11 (1782107231) 00010000:00010000:0.0:1782107234.307570:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107234.755970:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269211520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782107234.756035:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107234.756397:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211520 00000100:00100000:2.0:1782107234.756424:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211520 00000100:00100000:2.0:1782107234.756477:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1782107234.756487:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1868674269211520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782107234.756529:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:2.0:1782107234.756573:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1868674269211520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107234.756591:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1782107234.756679:0:3660:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967413 gen 2 00000004:00080000:3.0:1782107234.756685:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967412 committed transno 4294967413 00000004:00080000:3.0:1782107234.756705:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967413 committed transno 4294967413 00000100:00100000:3.0:1782107234.756723:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269211520:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1782107234.762067:0:8393:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000004:00080000:1.0:1782107234.762502:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 8 committed 00000004:00080000:1.0:1782107234.762531:0:7431:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 8 committed 00010000:00010000:1.0:1782107234.762556:0:7431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107234.762571:0:7431:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.762608:0:7431:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.762625:0:7431:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782107234.762647:0:7431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffffa08b42906000/0x7e3d6a8eb3a13d39 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x7e3d6a8eb3a13d40 expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782107234.762668:0:7431:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967385 is committed 00000100:00100000:2.0:1782107234.762671:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269211648:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:1.0:1782107234.762676:0:7431:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffffa08b435d1840 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:1.0:1782107234.762681:0:7431:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08c7be6a100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffffa08b435d1c00 00000020:00080000:1.0:1782107234.762685:0:7431:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].11 00000020:00080000:1.0:1782107234.762687:0:7431:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08c7be6a400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa08c412e9a00 00000020:00080000:1.0:1782107234.762690:0:7431:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].11 00000020:00080000:1.0:1782107234.762703:0:7431:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffffa08b43591f00 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:1.0:1782107234.762707:0:7431:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b4355af00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffffa08b43591180 00000020:00080000:1.0:1782107234.762710:0:7431:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].10 00000020:00080000:1.0:1782107234.762712:0:7431:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffffa08b4355a600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa08b44554200 00000020:00080000:1.0:1782107234.762714:0:7431:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].10 00000020:00080000:1.0:1782107234.762734:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 11 committed batchid 9 00000100:00100000:2.0:1782107234.762740:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1782107234.762793:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 9 00000100:00100000:2.0:1782107234.762828:0:9469:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211648 00000100:00100000:2.0:1782107234.762835:0:9469:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211648 00000100:00100000:3.0:1782107234.762963:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269211904:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1782107234.762963:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269211776:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1782107234.763001:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107234.763024:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211776 00000100:00100000:3.0:1782107234.763029:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211776 00000100:00080000:0.0:1782107234.763055:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107234.763063:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782107234.763073:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1868674269211776:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1782107234.763098:0:8397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1782107234.763145:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782107234.763152:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.763166:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107234.763168:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107234.763172:0:8397:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.763193:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.763202:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.763210:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107234.763295:0:9469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782107234.763303:0:9469:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3658:x1868674269211648:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782107234.763316:0:9469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107234.763348:0:9469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907600/0x7e3d6a8eb3a13d40 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13d39 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.763362:0:9469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffffa08c4380f200) 00010000:00010000:2.0:1782107234.763371:0:9469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107234.763438:0:9469:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269211648:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 136us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107234.763447:0:9469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1782107234.764128:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782107234.764255:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269211776:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1181us (1251us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782107234.764263:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782107234.764276:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782107234.764282:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08b4354d180, transno 4294967310 00000100:00100000:3.0:1782107234.764288:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107234.764299:0:3661:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffffa08c60853800 x1868674269211776/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782107250 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782107234.764309:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa08c60853800/2, rc 0, transno 4294967311 00000100:00100000:1.0:1782107234.764316:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c60853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269211776:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1782107234.764335:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269211904 00000100:00100000:3.0:1782107234.764340:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269211904 00000100:00100000:3.0:1782107234.764375:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782107234.764382:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269211904:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1782107234.764398:0:8399:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2 count 1 00010000:00010000:3.0:1782107234.764432:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.764448:0:8399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 5 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.764455:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107234.764463:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1782107234.764466:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.764493:0:8399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 5 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107234.764507:0:8399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 5 pid: 8397 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107234.764519:0:8399:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8399:1868674269212032:192.168.203.43@tcp:104: 00000100:00100000:1.0:1782107234.764551:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269211648:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1782107234.764579:0:8399:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c412ed780 going to sleep for 11 seconds 00000100:00080000:1.0:1782107234.764591:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782107234.766093:0:23830:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782107234.766102:0:23830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.766113:0:23830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907c00 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:0.0:1782107234.766117:0:23830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.766127:0:23830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.766144:0:23830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.766152:0:23830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f83497e1/0x7e3d6a8eb3a13d71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.767785:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107234.767791:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107234.767793:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107234.768645:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107234.770535:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031552 00000100:00100000:1.0:1782107234.770547:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031552 00010000:00010000:1.0:1782107234.770612:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 6 pid: 8397 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107234.770657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00100000:1.0:1782107234.770666:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2414:x1868674247031552:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782107234.770679:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782107234.770684:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 6 pid: 8397 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.770696:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 6 pid: 8397 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.770722:0:6503:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1782107234.770724:0:6503:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1782107234.770728:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.770737:0:6503:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107234.770756:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107234.770837:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:2414:x1868674247031552:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 171us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107234.770844:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 110 00000100:00080000:0.0:1782107234.770900:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782107234.778271:0:8399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d28406/0x7e3d6a8eb3a13be2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b419c expref: 5 pid: 8397 timeout: 771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107234.778295:0:8399:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8399:1868674269212032:192.168.203.43@tcp:104: 00010000:00010000:2.0:1782107234.778318:0:8399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.778329:0:8399:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.778357:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.778369:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.778377:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107234.778421:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782107234.778598:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269211904:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14214us (14308us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782107234.778607:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:2.0:1782107234.778660:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa08b41f55880/2, rc 0, transno 4294967308 00000100:00100000:2.0:1782107234.778665:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269211904:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1782107234.779818:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782107234.779828:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.779840:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906800 already unused, calling callback (ffffffffc0e666f0) 00010000:00010000:0.0:1782107234.779844:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.779865:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.779885:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.779891:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065731c6a/0x7e3d6a8eb3a13d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107234.779913:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107234.779915:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107234.779916:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107235.267988:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269212288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782107235.268056:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107235.268136:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107235.268143:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269212160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107235.268166:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107235.268196:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212288 00000100:00100000:1.0:1782107235.268203:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212288 00000100:00100000:1.0:1782107235.268242:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212160 00000100:00100000:1.0:1782107235.268245:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212160 00000100:00100000:1.0:1782107235.268269:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782107235.268278:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269212288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782107235.268306:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107235.268348:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269212288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107235.268355:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782107235.268373:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1782107235.268379:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269212160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107235.268388:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107235.268448:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269212160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107235.268454:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:1.0:1782107235.268473:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107235.268510:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269212160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107235.268524:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269212288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782107235.331804:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107235.468372:0:24013:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00000100:00100000:3.0:1782107235.607562:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107235.607604:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107235.607633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107235.607658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107235.607679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107235.607707:0:6511:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031680 00000100:00100000:3.0:1782107235.607715:0:6511:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031680 00000100:00100000:3.0:1782107235.607759:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 449 00000100:00100000:3.0:1782107235.607768:0:6511:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c51145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2412:x1868674247031680:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107235.607860:0:6511:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c51145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2412:x1868674247031680:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.607867:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 449 00000100:00100000:3.0:1782107235.607898:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031808 00000100:00100000:3.0:1782107235.607901:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031808 00000100:00100000:3.0:1782107235.607935:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247031936 00000100:00100000:3.0:1782107235.607952:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247031936 00000100:00100000:3.0:1782107235.607978:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 709 00000100:00100000:3.0:1782107235.607985:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247031808:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107235.608014:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247031808:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.608020:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 709 00000100:00100000:3.0:1782107235.608032:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 710 00000100:00100000:3.0:1782107235.608038:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247031936:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107235.608061:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247031936:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.608067:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 710 00000100:00100000:3.0:1782107235.608084:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032064 00000100:00100000:3.0:1782107235.608088:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032064 00000100:00100000:3.0:1782107235.608112:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032192 00000100:00100000:3.0:1782107235.608115:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032192 00000100:00100000:3.0:1782107235.608132:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:3.0:1782107235.608138:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247032064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107235.608163:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247032064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.608170:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 197 00000100:00100000:3.0:1782107235.608181:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00100000:3.0:1782107235.608188:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247032192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107235.608211:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2412:x1868674247032192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.608217:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 198 00000100:00080000:1.0:1782107235.608443:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107235.608448:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782107235.608450:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107235.779736:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782107235.779812:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780013:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107235.780041:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107235.780119:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212416 00000100:00100000:1.0:1782107235.780127:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212416 00000100:00100000:1.0:1782107235.780174:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212544 00000100:00100000:1.0:1782107235.780178:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212544 00000100:00100000:1.0:1782107235.780206:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782107235.780215:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269212416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782107235.780243:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107235.780285:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1868674269212416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107235.780292:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782107235.780311:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1782107235.780317:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269212544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107235.780326:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107235.780349:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269212544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107235.780355:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1782107235.780371:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107235.780454:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107235.780484:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269212416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782107235.780700:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269212672:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780731:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780761:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269213184:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780784:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780815:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269213696:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780838:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780858:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782107235.780864:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269212800:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780910:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780927:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269213312:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780946:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.780963:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269213824:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.780983:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781009:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213184 00000100:00100000:2.0:1782107235.781013:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213184 00000100:00100000:2.0:1782107235.781040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1782107235.781046:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c447db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269213184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781083:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c447db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269213184:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1782107235.781106:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213696 00000100:00100000:2.0:1782107235.781109:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213696 00000100:00100000:2.0:1782107235.781132:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782107235.781139:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269213696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781166:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269213696:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781178:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782107235.781196:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212800 00000100:00100000:2.0:1782107235.781199:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212800 00000100:00100000:2.0:1782107235.781219:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213312 00000100:00100000:2.0:1782107235.781221:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213312 00000100:00100000:2.0:1782107235.781239:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213824 00000100:00100000:2.0:1782107235.781241:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213824 00000100:00100000:2.0:1782107235.781259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1782107235.781265:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269212800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781296:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269212800:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781301:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1782107235.781312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1782107235.781317:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781340:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269213312:12345-0@lo:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781346:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1782107235.781357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1782107235.781363:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269213824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781387:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269213824:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00080000:2.0:1782107235.781455:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107235.781465:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269213056:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781488:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781505:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269213568:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781531:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781548:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782107235.781555:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269212928:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781575:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781591:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269213440:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781610:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781623:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1868674269213952:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781639:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107235.781659:0:10279:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213568 00000100:00100000:2.0:1782107235.781662:0:10279:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213568 00000100:00100000:2.0:1782107235.781684:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782107235.781689:0:10279:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269213568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781718:0:10279:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269213568:12345-0@lo:400:kworker.0 Request processed in 28us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781724:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782107235.781740:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212928 00000100:00100000:2.0:1782107235.781743:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212928 00000100:00100000:2.0:1782107235.781762:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1782107235.781767:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269212928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781809:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1868674269212928:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781815:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1782107235.781831:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213056 00000100:00100000:2.0:1782107235.781834:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213056 00000100:00100000:2.0:1782107235.781851:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213440 00000100:00100000:2.0:1782107235.781854:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213440 00000100:00100000:2.0:1782107235.781872:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1782107235.781884:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781913:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1868674269213056:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781919:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1782107235.781928:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269213952 00000100:00100000:2.0:1782107235.781931:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269213952 00000100:00100000:2.0:1782107235.781950:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1782107235.781956:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.781981:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1868674269213440:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.781986:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1782107235.781996:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1782107235.782002:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1868674269213952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782025:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1868674269213952:12345-0@lo:400:kworker.0 Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107235.782031:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00080000:2.0:1782107235.782053:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782107235.782080:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269212928:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782089:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1868674269213440:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782097:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1868674269213952:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782105:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1868674269213056:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782113:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269213568:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782145:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269212800:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782164:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269213312:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782172:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269213824:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782181:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269213184:0@lo:400:kworker.0 00000100:00100000:2.0:1782107235.782189:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269213696:0@lo:400:kworker.0 00000100:00100000:3.0:1782107235.782272:0:6509:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269212672 00000100:00100000:3.0:1782107235.782276:0:6509:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269212672 00000100:00100000:3.0:1782107235.782310:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1782107235.782317:0:6509:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c51146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269212672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107235.782356:0:6509:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c51146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269212672:12345-0@lo:400:kworker.0 Request processed in 40us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107235.782362:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1782107235.782393:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c447f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269212672:0@lo:400:kworker.0 00010000:00010000:1.0:1782107236.356064:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107237.381224:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107237.511577:0:24061:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 01:47:15 (1782107235) 00000100:00100000:3.0:1782107237.827889:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107237.827912:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269214080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782107237.827983:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107237.828103:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214080 00000100:00100000:2.0:1782107237.828110:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214080 00000100:00100000:2.0:1782107237.828170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1782107237.828180:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269214080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782107237.828314:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1782107237.828370:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269214080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107237.828378:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1782107237.828487:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269214080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782107238.407096:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107238.821111:0:24110:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00010000:00010000:1.0:1782107239.433030:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107239.876282:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269214208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782107239.876346:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107239.876440:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214208 00000100:00100000:0.0:1782107239.876448:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214208 00000100:00100000:0.0:1782107239.876501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1782107239.876511:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1868674269214208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782107239.876543:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:0.0:1782107239.876587:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3660:x1868674269214208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107239.876595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1782107239.876644:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269214208:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1782107240.348824:0:24158:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 01:47:18 (1782107238) 00000100:00100000:1.0:1782107240.387599:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269214336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782107240.387674:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107240.387841:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214336 00000100:00100000:2.0:1782107240.387843:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782107240.387853:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269214464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107240.387855:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214336 00000100:00100000:2.0:1782107240.387881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107240.387904:0:8402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214464 00000100:00100000:2.0:1782107240.387907:0:8402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214464 00000100:00100000:1.0:1782107240.387908:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1782107240.387916:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269214336:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782107240.387926:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1782107240.387931:0:8402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269214464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107240.387947:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1782107240.387947:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107240.387984:0:8402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269214464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.387984:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269214336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.387991:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:1.0:1782107240.388267:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107240.388796:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1782107240.388796:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269214336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782107240.388845:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269214464:0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1782107240.392169:0:7431:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 11 batchid updated 00000020:00080000:1.0:1782107240.392208:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00000001:00080000:2.0:1782107240.393460:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000004:00080000:1.0:1782107240.393908:0:7453:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08c7b85a540 with version 24 00000020:00080000:1.0:1782107240.393924:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 10 cancel update log [0x200000401:0x3:0x0].10: rc = 0 00000020:00080000:1.0:1782107240.394004:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 10 cancel update log [0x240000400:0x3:0x0].10: rc = 0 00000001:00080000:3.0:1782107240.394012:0:8393:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:1.0:1782107240.394035:0:7453:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffffa08c45543cc0 with version 25 00000020:00080000:1.0:1782107240.394038:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 11 cancel update log [0x200000401:0x3:0x0].11: rc = 0 00000020:00080000:1.0:1782107240.394059:0:7453:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 11 cancel update log [0x240000400:0x3:0x0].11: rc = 0 00000020:00080000:1.0:1782107240.394067:0:7453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 11 00000004:00080000:0.0:1782107240.394092:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 24 rpc_version 24 00000020:00100000:0.0:1782107240.394177:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107240.394191:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08c7ba2df80 x1868674269214720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107240.394226:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269214720:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782107240.394303:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107240.394352:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c42aaf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107240.395060:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214720 00000100:00100000:1.0:1782107240.395069:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214720 00000100:00100000:1.0:1782107240.395117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1782107240.395126:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7445:x1868674269214720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782107240.395303:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7445:x1868674269214720:12345-0@lo:1000:osp_up0-1.0 Request processed in 177us (1000us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782107240.395311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1782107240.397053:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba2df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269214720:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1782107240.397072:0:7445:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c453a7840 version 25 rpc_version 25 00000020:00100000:0.0:1782107240.397156:0:7445:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107240.397906:0:7445:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b4155c000 x1868674269214976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107240.397932:0:7445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269214976:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782107240.398001:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107240.398083:0:7445:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c42aaf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107240.398547:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269214976 00000100:00100000:1.0:1782107240.398555:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269214976 00000100:00100000:1.0:1782107240.398640:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1782107240.398649:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7445:x1868674269214976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782107240.398808:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7445:x1868674269214976:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (806us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1782107240.398815:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1782107240.398921:0:7445:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4155c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7445:1868674269214976:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1782107240.455098:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107240.725373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107240.725661:0:6510:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032320 00000100:00100000:1.0:1782107240.725681:0:6510:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032320 00000100:00100000:1.0:1782107240.725733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 451 00000100:00100000:1.0:1782107240.725742:0:6510:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c51145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2413:x1868674247032320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107240.725828:0:6510:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c51145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2413:x1868674247032320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 86us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.725835:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 451 00000100:00100000:0.0:1782107240.726597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107240.726719:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107240.726762:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107240.726782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107240.726993:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032576 00000100:00100000:3.0:1782107240.727000:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032576 00000100:00100000:3.0:1782107240.727054:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032448 00000100:00100000:3.0:1782107240.727058:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032448 00000100:00100000:3.0:1782107240.727081:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 717 00000100:00100000:3.0:1782107240.727090:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107240.727145:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 57us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107240.727153:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 717 00000100:00100000:3.0:1782107240.727167:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 718 00000100:00100000:3.0:1782107240.727173:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1782107240.727228:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 55us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107240.727235:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 718 00000100:00100000:2.0:1782107240.727640:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032832 00000100:00100000:2.0:1782107240.727645:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032832 00000100:00100000:2.0:1782107240.727674:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032704 00000100:00100000:2.0:1782107240.727678:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032704 00000100:00100000:2.0:1782107240.727702:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:2.0:1782107240.727709:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1782107240.727745:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 37us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.727764:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 201 00000100:00100000:2.0:1782107240.727777:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00100000:2.0:1782107240.727784:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1782107240.727808:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247032704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.727813:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 202 00000100:00080000:0.0:1782107240.729565:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782107240.729574:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107240.729577:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782107240.729579:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782107240.899954:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269215104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782107240.900023:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107240.900140:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215104 00000100:00100000:0.0:1782107240.900149:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215104 00000100:00100000:0.0:1782107240.900207:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782107240.900215:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269215104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782107240.900255:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782107240.900301:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1868674269215104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107240.900308:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1782107240.900788:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269215488:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.900823:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.900850:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1868674269216000:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.900873:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.900896:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1868674269216512:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.900914:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.900934:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782107240.900941:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1868674269215616:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.900960:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.900980:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269216128:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.901003:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901021:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269216640:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.901045:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107240.901052:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269215232:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.901074:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216000 00000100:00100000:3.0:1782107240.901079:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216000 00000100:00100000:1.0:1782107240.901091:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901110:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1782107240.901119:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1868674269216000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901135:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269215744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901167:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901169:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1868674269216000:12345-0@lo:400:kworker.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107240.901178:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1782107240.901192:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216512 00000100:00100000:3.0:1782107240.901195:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216512 00000100:00100000:1.0:1782107240.901198:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216256:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901223:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901231:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215616 00000100:00100000:3.0:1782107240.901235:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215616 00000100:00100000:1.0:1782107240.901242:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107240.901262:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1782107240.901267:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901274:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1868674269216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901287:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782107240.901294:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269215360:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.901316:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1868674269216512:12345-0@lo:400:kworker.0 Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.901323:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901327:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1782107240.901338:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269215872:0@lo:400:kworker.0 00000100:00100000:3.0:1782107240.901342:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215360 00000100:00100000:3.0:1782107240.901346:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215360 00000100:00100000:3.0:1782107240.901368:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1782107240.901374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107240.901381:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1868674269215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901386:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269216384:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901424:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107240.901459:0:6511:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215232 00000100:00100000:1.0:1782107240.901462:0:6511:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215232 00000100:00100000:1.0:1782107240.901487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1782107240.901493:0:6511:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c506edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901525:0:6511:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c506edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43809427-66c4-4a66-b088-77a1495576b0+23:3660:x1868674269215232:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.901531:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00080000:2.0:1782107240.901554:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782107240.901560:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107240.901562:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215488 00000100:00100000:1.0:1782107240.901566:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215488 00000100:00100000:1.0:1782107240.901590:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215744 00000100:00100000:2.0:1782107240.901591:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967308 gen 2 00000100:00100000:1.0:1782107240.901593:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215744 00000004:00080000:2.0:1782107240.901600:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08b41f55880, transno 4294967308 00000100:00100000:1.0:1782107240.901610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1782107240.901616:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3658:x1868674269215488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.901621:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1868674269215104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782107240.901653:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3658:x1868674269215488:12345-0@lo:400:kworker.0 Request processed in 36us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.901659:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1782107240.901669:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269215872 00000100:00100000:1.0:1782107240.901674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1782107240.901680:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269215872 00000100:00100000:1.0:1782107240.901683:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269215744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.901712:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216384 00000100:00100000:2.0:1782107240.901715:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216384 00000100:00100000:1.0:1782107240.901732:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269215744:12345-0@lo:400:kworker.0 Request processed in 51us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.901737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1782107240.901744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1782107240.901749:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901778:0:8402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216768 00000100:00100000:1.0:1782107240.901782:0:8402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216768 00000100:00100000:2.0:1782107240.901797:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269215360:12345-0@lo:400:kworker.0 Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.901804:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1782107240.901813:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782107240.901823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1782107240.901830:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269215872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901838:0:8402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107240.901853:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107240.901860:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269215872:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.901867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1782107240.901884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1782107240.901890:0:8402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107240.901894:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269216384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.901905:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1782107240.901930:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216128 00000100:00100000:2.0:1782107240.901935:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269216384:12345-0@lo:400:kworker.0 Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.901935:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216128 00000100:00100000:2.0:1782107240.901944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1782107240.901962:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216640 00000100:00100000:1.0:1782107240.901966:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216640 00000100:00100000:2.0:1782107240.901970:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216256 00000100:00100000:2.0:1782107240.901975:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216256 00000100:00100000:1.0:1782107240.901984:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1782107240.901993:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269216128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902000:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782107240.902010:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269216640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902029:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269216128:12345-0@lo:400:kworker.0 Request processed in 37us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.902035:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782107240.902052:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269216640:12345-0@lo:400:kworker.0 Request processed in 44us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.902055:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782107240.902067:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1782107240.902068:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782107240.902087:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107240.902092:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107240.902101:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216256:12345-0@lo:400:kworker.0 Request processed in 37us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107240.902108:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1782107240.902154:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269215360:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902160:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1782107240.902166:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa08c60853800, transno 4294967311 00000100:00100000:1.0:1782107240.902170:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269215872:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902181:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269216128:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902184:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269216384:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902203:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269216640:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902204:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:43809427-66c4-4a66-b088-77a1495576b0:3660:1868674269215232:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902226:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269215488:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902228:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269215744:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902244:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1868674269216000:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902258:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216256:0@lo:400:kworker.0 00000100:00100000:2.0:1782107240.902262:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1868674269216512:0@lo:400:kworker.0 00000100:00100000:1.0:1782107240.902278:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107240.903972:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1868674269215616:12345-0@lo:400:kworker.0 Request processed in 2589us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107240.903983:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1782107240.904175:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1868674269215616:0@lo:400:kworker.0 00010000:00010000:3.0:1782107241.476756:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107241.518137:0:24207:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00010000:00010000:1.0:1782107242.500768:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107242.948267:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107242.948287:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782107242.948352:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107242.948705:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269216896 00000100:00100000:3.0:1782107242.948713:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269216896 00000100:00100000:3.0:1782107242.948776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1782107242.948786:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782107242.948817:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:3.0:1782107242.948875:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1868674269216896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107242.948882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1782107242.949049:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1868674269216896:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1782107242.953328:0:24255:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 01:47:21 (1782107241) 00010000:00010000:1.0:1782107243.523653:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107244.429879:0:24303:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00010000:00010000:3.0:1782107244.547852:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107244.996186:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269217024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782107244.996255:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107244.996668:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217024 00000100:00100000:0.0:1782107244.996677:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217024 00000100:00100000:0.0:1782107244.996739:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1782107244.996750:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3658:x1868674269217024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782107244.996786:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446109184 avail 1299869696 00000100:00100000:0.0:1782107244.997238:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3658:x1868674269217024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 489us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107244.997246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1782107244.997936:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269217024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782107245.508791:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107245.508813:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269217152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107245.508885:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107245.509928:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107245.509944:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782107245.509986:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107245.510973:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217152 00000100:00100000:2.0:1782107245.510985:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217152 00000100:00100000:2.0:1782107245.511044:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217280 00000100:00100000:2.0:1782107245.511048:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217280 00000100:00100000:2.0:1782107245.511067:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782107245.511075:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269217152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107245.511113:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107245.511167:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269217152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107245.511174:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782107245.511394:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1782107245.511422:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1868674269217280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782107245.511433:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16604864 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107245.511464:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1868674269217280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107245.511482:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:1.0:1782107245.511643:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107245.511689:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782107245.516042:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b4354d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269217152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782107245.571680:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107245.851354:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107245.851396:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107245.851528:0:6509:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247032960 00000100:00100000:0.0:1782107245.851538:0:6509:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247032960 00000100:00100000:0.0:1782107245.851582:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 453 00000100:00100000:0.0:1782107245.851592:0:6509:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c506ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2414:x1868674247032960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1782107245.851662:0:6509:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c506ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87d3e82f-e99c-4ac6-accd-6b70667f4a2e+9:2414:x1868674247032960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107245.851669:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 453 00000100:00100000:3.0:1782107245.852057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107245.852166:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033216 00000100:00100000:1.0:1782107245.852171:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033216 00000100:00100000:1.0:1782107245.852209:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033088 00000100:00100000:1.0:1782107245.852212:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033088 00000100:00100000:1.0:1782107245.852231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 725 00000100:00100000:1.0:1782107245.852239:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247033216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107245.852281:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247033216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 43us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107245.852288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 725 00000100:00100000:1.0:1782107245.852316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 726 00000100:00100000:1.0:1782107245.852322:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7bbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247033088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107245.852349:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7bbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2414:x1868674247033088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107245.852354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 726 00000100:00080000:1.0:1782107245.852474:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782107245.852478:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782107245.853710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107245.853810:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033344 00000100:00100000:2.0:1782107245.853818:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033344 00000100:00100000:2.0:1782107245.853872:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:2.0:1782107245.853881:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2410:x1868674247033344:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:2.0:1782107245.853909:0:8399:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x7e3d6a8eb3a13a0d 00000100:00080000:2.0:1782107245.853916:0:8399:0:(import.c:65:import_set_state_nolock()) ffffa08b434f4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782107245.853955:0:8399:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1782107245.854089:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+2:2410:x1868674247033344:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 208us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107245.854096:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00010000:00010000:1.0:1782107245.854427:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782107245.854434:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107245.862782:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107245.862880:0:8397:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033472 00000100:00100000:1.0:1782107245.862891:0:8397:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033472 00000100:00100000:1.0:1782107245.863103:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00100000:1.0:1782107245.863114:0:8397:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b4354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247033472:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1782107245.863178:0:8397:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b4354d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:2413:x1868674247033472:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 67us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107245.863186:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 206 00000100:00080000:2.0:1782107245.869287:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107246.020227:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269217408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107246.020294:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.020367:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217408 00000100:00100000:1.0:1782107246.020375:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217408 00000100:00100000:1.0:1782107246.021732:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1782107246.021750:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269217408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107246.022215:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107246.022287:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1868674269217408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 544us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.022294:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1782107246.022358:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1868674269217408:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782107246.023364:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107246.023469:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7ba51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269217536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782107246.023529:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.024818:0:8402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217536 00000100:00100000:2.0:1782107246.024829:0:8402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217536 00000100:00100000:2.0:1782107246.024896:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782107246.024905:0:8402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269217536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782107246.024929:0:8402:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 23969472 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782107246.024989:0:8402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269217536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.024996:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782107246.025043:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7ba51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269217536:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1782107246.025194:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107246.025902:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269217792:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.025941:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.025984:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269218304:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.026025:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b435c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269218816:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026044:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.026064:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782107246.026069:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269217920:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026089:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.026102:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1868674269218432:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026118:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.026130:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b435c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1868674269218944:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026146:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.026173:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217792 00000100:00100000:1.0:1782107246.026177:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217792 00000100:00100000:1.0:1782107246.026207:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218304 00000100:00100000:1.0:1782107246.026210:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218304 00000100:00100000:1.0:1782107246.026228:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218816 00000100:00100000:1.0:1782107246.026230:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218816 00000100:00100000:1.0:1782107246.026240:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218432 00000100:00100000:1.0:1782107246.026242:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218432 00000100:00100000:1.0:1782107246.026253:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218944 00000100:00100000:1.0:1782107246.026255:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218944 00000100:00100000:1.0:1782107246.026268:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1782107246.026274:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b435c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269217792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026316:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b435c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1868674269217792:12345-0@lo:400:kworker.0 Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.026323:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1782107246.026338:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1782107246.026344:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269218304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026379:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1868674269218304:12345-0@lo:400:kworker.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.026385:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1782107246.026439:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1782107246.026454:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269218816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.026481:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1868674269218816:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.026486:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1782107246.026509:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1782107246.026515:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1868674269218432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027093:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1868674269218048:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027129:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.027153:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269218560:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027177:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.027197:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782107246.027203:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43809427-66c4-4a66-b088-77a1495576b0:3658:1868674269217664:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027227:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.027250:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7bd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269218176:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027271:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.027286:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269218688:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027304:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.027331:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218560 00000100:00100000:3.0:1782107246.027335:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218560 00000100:00100000:3.0:1782107246.027362:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218688 00000100:00100000:3.0:1782107246.027365:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218688 00000100:00100000:3.0:1782107246.027428:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782107246.027444:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269218560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027484:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1868674269218560:12345-0@lo:400:kworker.0 Request processed in 41us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107246.027490:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782107246.027513:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782107246.027520:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027558:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269218688:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107246.027564:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782107246.027601:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269218688:0@lo:400:kworker.0 00000100:00100000:3.0:1782107246.027611:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1868674269218560:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.027823:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218048 00000100:00100000:2.0:1782107246.027828:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218048 00000100:00100000:2.0:1782107246.027851:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782107246.027864:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1868674269218944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.027875:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1868674269218432:12345-0@lo:400:kworker.0 Request processed in 1360us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.027882:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1782107246.027897:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1868674269218944:12345-0@lo:400:kworker.0 Request processed in 35us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.027898:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782107246.027903:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1782107246.027904:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7ba51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1868674269218048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.027924:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217920 00000100:00100000:2.0:1782107246.027927:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217920 00000100:00100000:1.0:1782107246.027935:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7ba51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1868674269218048:12345-0@lo:400:kworker.0 Request processed in 32us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.027940:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782107246.027948:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269218176 00000100:00100000:2.0:1782107246.027951:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269218176 00000100:00100000:1.0:1782107246.027960:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1782107246.027964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1782107246.027966:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3660:x1868674269217920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.027969:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269218176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.027995:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269218176:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.027995:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3660:x1868674269217920:12345-0@lo:400:kworker.0 Request processed in 29us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.028001:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1782107246.028093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00080000:0.0:1782107246.028207:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782107246.028212:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107246.028237:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269217920:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028248:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1868674269218432:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028270:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b435c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1868674269218944:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028282:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1868674269217792:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028291:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1868674269218304:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028302:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b435c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1868674269218816:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028339:0:6510:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269217664 00000100:00100000:0.0:1782107246.028343:0:6510:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269217664 00000100:00100000:0.0:1782107246.028369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1782107246.028375:0:6510:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c506ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43809427-66c4-4a66-b088-77a1495576b0+23:3658:x1868674269217664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028425:0:6510:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c506ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43809427-66c4-4a66-b088-77a1495576b0+23:3658:x1868674269217664:12345-0@lo:400:kworker.0 Request processed in 50us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.028632:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b41f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:43809427-66c4-4a66-b088-77a1495576b0:3658:1868674269217664:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.028655:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269218176:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.028665:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7bd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1868674269218048:0@lo:400:kworker.0 00000100:00100000:0.0:1782107246.028703:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000001:00080000:1.0:1782107246.544805:0:6495:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:02000400:0.0:1782107246.566237:0:24352:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 01:47:24 (1782107244) 00010000:00010000:1.0:1782107246.599930:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107246.785751:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107246.788999:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033600 00000100:00100000:1.0:1782107246.789018:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033600 00000100:00100000:1.0:1782107246.789088:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 362 00000100:00100000:1.0:1782107246.789097:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:40156:x1868674247033600:12345-192.168.203.43@tcp:41:stat.0 00000004:00000024:1.0:1782107246.789142:0:8982:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1782107246.789220:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:40156:x1868674247033600:12345-192.168.203.43@tcp:41:stat.0 Request processed in 125us (3478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.789228:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 362 00000100:00100000:3.0:1782107246.842987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107246.843128:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033728 00000100:00100000:0.0:1782107246.843138:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033728 00000100:00100000:0.0:1782107246.843195:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 363 00000100:00100000:0.0:1782107246.843205:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c7fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:40160:x1868674247033728:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107246.843224:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107246.843244:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b41fe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843302:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843331:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843342:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107246.843387:0:6518:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782107246.843391:0:6518:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782107246.843452:0:6518:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843475:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41fe expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843491:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41fe expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.843500:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107246.843503:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782107246.843507:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c7b942000, rc 0) 00000100:00100000:0.0:1782107246.843571:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c7fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:40160:x1868674247033728:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 367us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107246.843579:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 363 00000100:00100000:0.0:1782107246.850548:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107246.850640:0:6516:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247033856 00000100:00100000:3.0:1782107246.850649:0:6516:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247033856 00000100:00100000:3.0:1782107246.850701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 364 00000100:00100000:3.0:1782107246.850720:0:6516:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:40160:x1868674247033856:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1782107246.850740:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107246.850759:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b4205 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850820:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850834:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850860:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850917:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850925:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850931:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850970:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850977:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850982:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850988:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107246.850991:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.850997:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851008:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107246.851022:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107246.851028:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851040:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13d94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851053:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851058:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851063:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851069:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107246.851071:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851077:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851084:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffffa08c4380ff00) 00010000:00010000:3.0:1782107246.851086:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107246.851089:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851094:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13d9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851120:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4205 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851139:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107246.851141:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107246.851145:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4205 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.851153:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42907a00, rc 0) 00000100:00100000:3.0:1782107246.851206:0:6516:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:40160:x1868674247033856:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 496us (675us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107246.851213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 364 00000100:00100000:0.0:1782107246.857148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107246.857189:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034112 00000100:00100000:0.0:1782107246.857198:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034112 00000100:00100000:0.0:1782107246.857245:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 365 00000100:00100000:0.0:1782107246.857256:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:40160:x1868674247034112:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:0.0:1782107246.857319:0:8982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107246.857342:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942000/0x7e3d6a8eb3a13d86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b41fe expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857359:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107246.857365:0:8982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107246.857449:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857463:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857471:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857483:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13da9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857489:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13da9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.857494:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13da9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782107246.858650:0:8982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].10, 2152 off47616 00000040:00080000:0.0:1782107246.858738:0:8982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].10, 2352 off49016 00000004:00080000:0.0:1782107246.858746:0:8982:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa08b428813c0 with version 22 00000004:00080000:0.0:1782107246.858778:0:7831:0:(osp_trans.c:1330:osp_get_next_request()) ou ffffa08c7b85a300 version 22 rpc_version 22 00000020:00100000:0.0:1782107246.858808:0:7831:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782107246.858818:0:7831:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa08b42f32d80 x1868674269219200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107246.858853:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269219200:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782107246.858917:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107246.858960:0:7831:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b42881780 going to sleep for 11 seconds 00000100:00100000:0.0:1782107246.858980:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219200 00000100:00100000:0.0:1782107246.858986:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219200 00000100:00100000:0.0:1782107246.859627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1782107246.859637:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1868674269219200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782107246.861637:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1868674269219200:12345-0@lo:1000:osp_up1-0.0 Request processed in 1994us (2711us total) trans 4294967386 rc 0/0 00000100:00100000:0.0:1782107246.861650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1782107246.865235:0:7831:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f32d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1868674269219200:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1782107246.872695:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13db0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872726:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872737:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872756:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13db7 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872763:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13db7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872769:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13db7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872803:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872815:0:8982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.872826:0:8982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,1 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107246.872850:0:8982:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42f31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8982:1868674269219328:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1782107246.872912:0:8982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107246.872956:0:8982:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b42881e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782107246.872975:0:7835:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219328 00000100:00100000:0.0:1782107246.872982:0:7835:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219328 00000100:00100000:0.0:1782107246.874135:0:7835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1782107246.874147:0:7835:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8982:x1868674269219328:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1782107246.874169:0:7835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107246.874236:0:7835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7e3d6a8eb3a13dbe expref: -99 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.874260:0:7835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 7 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.874274:0:7835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 7 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.874282:0:7835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffffa08b42efa900) 00010000:00010000:0.0:1782107246.874284:0:7835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107246.874288:0:7835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c40031800, rc 0) 00000100:00100000:0.0:1782107246.874340:0:7835:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8982:x1868674269219328:12345-0@lo:101:mdt00_004.0 Request processed in 196us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107246.874358:0:7835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1782107246.876095:0:8982:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42f31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8982:1868674269219328:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1782107246.876124:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876138:0:8982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107246.876163:0:8982:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000084f64a00 reply state 000000007e6de44a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13db7 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876177:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942800/0x7e3d6a8eb3a13db7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876184:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:0.0:1782107246.876187:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107246.876192:0:8982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107246.876198:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876205:0:8982:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782107246.876215:0:8982:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x8:0x0] 00000004:00010000:0.0:1782107246.876221:0:8982:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000084f64a00 reply state 000000007e6de44a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13db0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876229:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943000/0x7e3d6a8eb3a13db0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876246:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffffa08b42efaa00) 00010000:00010000:0.0:1782107246.876248:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107246.876250:0:8982:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1782107246.876256:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 4096 00010000:00010000:0.0:1782107246.876265:0:8982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876271:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876276:0:8982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876281:0:8982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876287:0:8982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c7b943400 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107246.876291:0:8982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876297:0:8982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876307:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:0.0:1782107246.876310:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107246.876313:0:8982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876319:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b943400/0x7e3d6a8eb3a13da2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107246.876331:0:8982:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000084f64a00 reply state 000000007e6de44a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13da9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876344:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c7b942c00/0x7e3d6a8eb3a13da9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.876350:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffffa08b42efa600) 00010000:00010000:0.0:1782107246.876352:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107246.876355:0:8982:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1782107246.877581:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:40160:x1868674247034112:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 20320us (20436us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1782107246.877593:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 365 00000100:00100000:3.0:1782107246.939878:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107246.939960:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034240 00000100:00100000:1.0:1782107246.939971:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034240 00000100:00100000:1.0:1782107246.940030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 366 00000100:00100000:1.0:1782107246.940040:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+7:40163:x1868674247034240:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1782107246.940061:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107246.940079:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13dcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b420c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940233:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eae00/0x7e3d6a8eb3a13dd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940259:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eae00/0x7e3d6a8eb3a13dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940271:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eae00/0x7e3d6a8eb3a13dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107246.940380:0:6518:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782107246.940384:0:6518:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782107246.940480:0:6518:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eae00/0x7e3d6a8eb3a13dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940515:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13dcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b420c expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940568:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eae00/0x7e3d6a8eb3a13dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b420c expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.940577:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:1.0:1782107246.940603:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782107246.940608:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412eae00, rc 0) 00000100:00100000:1.0:1782107246.940770:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:40163:x1868674247034240:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 731us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.940778:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 366 00000100:00100000:1.0:1782107246.945344:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1782107246.945890:0:6516:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034368 00000100:00100000:3.0:1782107246.945901:0:6516:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034368 00000100:00100000:3.0:1782107246.945959:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 367 00000100:00100000:3.0:1782107246.945969:0:6516:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+8:40163:x1868674247034368:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1782107246.945992:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107246.946623:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b4213 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946687:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946702:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946724:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946752:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946760:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946766:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946842:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13def lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946851:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946859:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107246.946933:0:6516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 4096 00000004:00200000:3.0:1782107246.946939:0:6516:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1782107246.946957:0:6516:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946969:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946975:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946982:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.946997:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42907a00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107246.947002:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948113:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948134:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa08c43d2b100) 00010000:00010000:3.0:1782107246.948137:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107246.948143:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948149:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42907a00/0x7e3d6a8eb3a13de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948162:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948168:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948174:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948179:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08b42906600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:3.0:1782107246.948182:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948188:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948209:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffffa08b42efa600) 00010000:00010000:3.0:1782107246.948211:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107246.948214:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948220:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906600/0x7e3d6a8eb3a13de8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948255:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906800/0x7e3d6a8eb3a13dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4213 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948269:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08b42906200/0x7e3d6a8eb3a13def lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4213 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.948275:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffffa08b42efaa00) 00010000:00010000:3.0:1782107246.948278:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782107246.948280:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08b42906200, rc 0) 00000100:00100000:3.0:1782107246.948352:0:6516:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:40163:x1868674247034368:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2384us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107246.948361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 367 00000100:00100000:3.0:1782107246.952299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107246.952375:0:18105:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034496 00000100:00100000:1.0:1782107246.952384:0:18105:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034496 00000100:00100000:1.0:1782107246.952466:0:18105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 368 00000100:00100000:1.0:1782107246.952475:0:18105:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+9:40163:x1868674247034496:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1782107246.952493:0:18105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107246.952510:0:18105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea600/0x7e3d6a8eb3a13df6 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b421a expref: -99 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.952772:0:18105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a13dfd lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.952798:0:18105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a13dfd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.952809:0:18105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a13dfd lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107246.952855:0:18105:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1782107246.952860:0:18105:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1782107246.952895:0:18105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea600/0x7e3d6a8eb3a13df6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b421a expref: 11 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.952910:0:18105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a13dfd lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b421a expref: 10 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.952920:0:18105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:1.0:1782107246.952922:0:18105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782107246.952926:0:18105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412eb400, rc 0) 00000100:00100000:1.0:1782107246.953299:0:18105:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:40163:x1868674247034496:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 822us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.953306:0:18105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 368 00000100:00100000:0.0:1782107246.959062:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107246.959122:0:6518:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034624 00000100:00100000:1.0:1782107246.959132:0:6518:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034624 00000100:00100000:1.0:1782107246.959188:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 369 00000100:00100000:1.0:1782107246.959197:0:6518:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:40163:x1868674247034624:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1782107246.959218:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107246.959238:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebc00/0x7e3d6a8eb3a13e04 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b4221 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.959319:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.959334:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 6 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.959343:0:6518:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 4/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.959374:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 6 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107246.959389:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c4abbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6518:1868674269219456:0@lo:104: 00000100:00100000:1.0:1782107246.959477:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107246.959519:0:6518:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08c42aaf480 going to sleep for 11 seconds 00000100:00100000:3.0:1782107246.959779:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219456 00000100:00100000:3.0:1782107246.959784:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219456 00000100:00100000:3.0:1782107246.959812:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782107246.959820:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b41f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6518:x1868674269219456:12345-0@lo:104: 00010000:00010000:3.0:1782107246.959830:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.959893:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782107246.959899:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b41f55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6518:x1868674269219456:12345-0@lo:104: Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107246.959906:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1782107246.959926:0:23830:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107246.959931:0:23830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.959939:0:23830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c40031c00 already unused, calling callback (ffffffffc1a15ee0) 00010000:00010000:3.0:1782107246.959945:0:23830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782107246.959953:0:23830:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.959977:0:23830:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 2/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.959984:0:23830:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107246.960017:0:23830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 1/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.960024:0:23830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffffa08c40031c00/0x7e3d6a8eb3a13dbe lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x7e3d6a8eb3a13dc5 expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.960041:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107246.960042:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107246.960044:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107246.960062:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269219584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782107246.960090:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107246.960127:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219584 00000100:00100000:3.0:1782107246.960131:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219584 00010000:00010000:3.0:1782107246.960145:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 7 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107246.960166:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782107246.960173:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3658:x1868674269219584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782107246.960182:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782107246.960745:0:6518:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c4abbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6518:1868674269219456:0@lo:104: 00010000:00010000:3.0:1782107246.960767:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782107246.962245:0:7431:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967386 is committed 00010000:00010000:1.0:1782107246.962954:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13dc5 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x7e3d6a8eb3a13dbe expref: 6 pid: 7835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.962972:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffffa08b42efa900) 00010000:00010000:1.0:1782107246.962977:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: --/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.962987:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.962994:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.963123:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782107246.963207:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269219584:12345-0@lo:103:ldlm_bl.0 Request processed in 3033us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.963216:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782107246.963300:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269219584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782107246.963349:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107246.963358:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107246.963758:0:6518:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1782107246.963764:0:6518:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1782107246.963805:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412ebc00/0x7e3d6a8eb3a13e04 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4221 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.963822:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffffa08c412eb800/0x7e3d6a8eb3a13e0b lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4221 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.963829:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x8:0x0].0x0 (ffffa08b42efa900) 00010000:00010000:0.0:1782107246.963832:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782107246.963834:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412eb800, rc 0) 00000100:00100000:0.0:1782107246.963915:0:6518:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eadce33-9ab8-4caf-b349-1b7b3db092bc+6:40163:x1868674247034624:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 4719us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107246.963922:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 369 00000100:00100000:3.0:1782107246.966764:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1782107246.966826:0:7836:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247034752 00000100:00100000:1.0:1782107246.966835:0:7836:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247034752 00000100:00100000:1.0:1782107246.966889:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 370 00000100:00100000:1.0:1782107246.966899:0:7836:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:40163:x1868674247034752:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1782107246.966921:0:7836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107246.966941:0:7836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea600/0x7e3d6a8eb3a13e12 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b4228 expref: -99 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967004:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967030:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967041:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967073:0:7836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967081:0:7836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967088:0:7836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967142:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967166:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 2/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967173:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967178:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412eb600 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1782107246.967183:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967190:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967200:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:1.0:1782107246.967203:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107246.967207:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967213:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb600/0x7e3d6a8eb3a13e19 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967225:0:7836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967231:0:7836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967236:0:7836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967241:0:7836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c412eb200 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:1.0:1782107246.967248:0:7836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967254:0:7836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967261:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffffa08c51e20e00) 00010000:00010000:1.0:1782107246.967264:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107246.967267:0:7836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967272:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb200/0x7e3d6a8eb3a13e20 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967301:0:7836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea600/0x7e3d6a8eb3a13e12 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4228 expref: 11 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967311:0:7836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:1.0:1782107246.967313:0:7836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107246.967317:0:7836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412ea600/0x7e3d6a8eb3a13e12 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4228 expref: 11 pid: 7836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107246.967326:0:7836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c412ea600, rc 0) 00000100:00100000:1.0:1782107246.967465:0:7836:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:40163:x1868674247034752:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 567us (710us total) trans 0 rc 301/301 00000100:00100000:1.0:1782107246.967473:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 370 00000100:00100000:2.0:1782107246.970936:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107246.971007:0:8982:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247035008 00000100:00100000:0.0:1782107246.971037:0:8982:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247035008 00000100:00100000:0.0:1782107246.971088:0:8982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 371 00000100:00100000:0.0:1782107246.971098:0:8982:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c60853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+10:40163:x1868674247035008:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107246.971119:0:8982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107246.971122:0:8982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782107246.971146:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c412eb400/0x7e3d6a8eb3a13dfd lrc: 0/0,0 mode: --/PR res: [0x200000400:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b421a expref: 10 pid: 18105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971163:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:0.0:1782107246.971168:0:8982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107246.971180:0:8982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030a00/0x7e3d6a8eb3a13e27 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b422f expref: -99 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971269:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 3/0,1 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971282:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971291:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971305:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13e35 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971311:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13e35 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971317:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13e35 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971725:0:8982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971735:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971743:0:8982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107246.971752:0:8982:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 0 00010000:00010000:0.0:1782107246.971774:0:8982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971781:0:8982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971788:0:8982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971794:0:8982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971800:0:8982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c40031000 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107246.971804:0:8982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971811:0:8982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971820:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0x0 (ffffa08b42efaf00) 00010000:00010000:0.0:1782107246.971824:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107246.971834:0:8982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 3/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971840:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031000/0x7e3d6a8eb3a13e2e lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107246.971852:0:8982:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d86018ed reply state 0000000071d153cc transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13e35 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971863:0:8982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030600/0x7e3d6a8eb3a13e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x8:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971869:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x8:0x0].0xe0be4298 (ffffa08b42efa500) 00010000:00010000:0.0:1782107246.971871:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782107246.971874:0:8982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107246.971899:0:8982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030a00/0x7e3d6a8eb3a13e27 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 12 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971913:0:8982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 11 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.971920:0:8982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffffa08b42efa400) 00010000:00010000:0.0:1782107246.971922:0:8982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107246.971924:0:8982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c40030000, rc 0) 00000100:00100000:0.0:1782107246.971990:0:8982:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c60853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:40163:x1868674247035008:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 894us (1062us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1782107246.971996:0:8982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 371 00000100:00100000:2.0:1782107246.975602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107246.975763:0:6517:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247035264 00000100:00100000:0.0:1782107246.975772:0:6517:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247035264 00000100:00100000:0.0:1782107246.975826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 372 00000100:00100000:0.0:1782107246.975837:0:6517:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:40163:x1868674247035264:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1782107246.975869:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107246.975890:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13e4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x518b9a3576b4236 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.975991:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.976005:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 13 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.976027:0:6517:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.976061:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 13 pid: 8982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.976074:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 13 pid: 8982 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107246.976086:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1868674269219712:192.168.203.43@tcp:104: 00000100:00100000:0.0:1782107246.976154:0:6517:0:(client.c:2692:ptlrpc_set_wait()) set ffffa08b42881600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107246.979489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1782107246.979575:0:9470:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247035392 00000100:00100000:2.0:1782107246.979584:0:9470:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247035392 00010000:00010000:2.0:1782107246.979621:0:9470:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 14 pid: 8982 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107246.979662:0:9470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 112 00000100:00100000:2.0:1782107246.979671:0:9470:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c4abbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:2414:x1868674247035392:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782107246.979682:0:9470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782107246.979688:0:9470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 14 pid: 8982 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107246.979726:0:9470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 14 pid: 8982 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107246.979747:0:9470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffffa08b42efa400) 00010000:00010000:2.0:1782107246.979751:0:9470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107246.979769:0:9470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107246.979777:0:9470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107246.979796:0:9470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782107246.979851:0:9470:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c4abbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2eadce33-9ab8-4caf-b349-1b7b3db092bc+14:2414:x1868674247035392:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.979859:0:9470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 112 00010000:00010000:0.0:1782107246.981723:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40030000/0x7e3d6a8eb3a13e3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x518b9a3576b422f expref: 13 pid: 8982 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107246.981748:0:6517:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1868674269219712:192.168.203.43@tcp:104: 00010000:00010000:0.0:1782107246.981768:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981793:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981799:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107246.981827:0:6517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 0 00010000:00010000:0.0:1782107246.981969:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981977:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981983:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981988:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa08c40031c00 already unused, calling callback (ffffffffc1a094f0) 00010000:00010000:0.0:1782107246.981992:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.981999:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.982019:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffffa08b42efa400) 00010000:00010000:0.0:1782107246.982022:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782107246.982025:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.982030:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031c00/0x7e3d6a8eb3a13e51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.982076:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13e4a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4236 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.982086:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffffa08b42efa400) 00010000:00010000:0.0:1782107246.982088:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782107246.982092:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa08c40031800/0x7e3d6a8eb3a13e4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x518b9a3576b4236 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107246.982107:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa08c40031800, rc 0) 00000100:00100000:0.0:1782107246.982170:0:6517:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+11:40163:x1868674247035264:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 6336us (6577us total) trans 0 rc 301/301 00000100:00100000:0.0:1782107246.983783:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 372 00000100:00100000:3.0:1782107246.988111:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1782107246.988273:0:6519:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674247035648 00000100:00100000:0.0:1782107246.988284:0:6519:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674247035648 00000100:00100000:0.0:1782107246.988341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 74 00000100:00100000:0.0:1782107246.988351:0:6519:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08c81ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+11:40163:x1868674247035648:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:0.0:1782107246.988622:0:6519:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08c81ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+12:40163:x1868674247035648:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 272us (519us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1782107246.988630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 74 00010000:00010000:1.0:1782107247.620350:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107248.067927:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107248.067947:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269219840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782107248.068009:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107248.068075:0:6521:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219840 00000100:00100000:2.0:1782107248.068083:0:6521:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219840 00000100:00100000:2.0:1782107248.068136:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1782107248.068145:0:6521:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269219840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782107248.068177:0:6521:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1782107248.068222:0:6521:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1868674269219840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107248.068239:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:3.0:1782107248.068249:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967386 gen 2 00000004:00080000:3.0:1782107248.068256:0:3658:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967386 committed transno 4294967386 00000100:00100000:3.0:1782107248.068287:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b434c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1868674269219840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782107248.651226:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107248.778663:0:24400:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1782107249.668532:0:23830:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107250.115787:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107250.115809:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269219968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782107250.115891:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107250.116430:0:6522:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269219968 00000100:00100000:0.0:1782107250.116438:0:6522:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269219968 00000100:00100000:0.0:1782107250.116486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1782107250.116494:0:6522:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269219968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782107250.116527:0:6522:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446096896 avail 1299857408 00000100:00100000:0.0:1782107250.116582:0:6522:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b434c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1868674269219968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107250.116602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1782107250.116782:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967415 gen 2 00000004:00080000:2.0:1782107250.116788:0:3661:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967414 committed transno 4294967415 00000004:00080000:2.0:1782107250.116805:0:3661:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967415 committed transno 4294967415 00000100:00100000:2.0:1782107250.116821:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b42eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1868674269219968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782107250.628646:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107250.628668:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08c7a522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269220096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782107250.628746:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107250.629040:0:17563:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269220096 00000100:00100000:1.0:1782107250.629059:0:17563:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269220096 00000100:00100000:1.0:1782107250.629120:0:17563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1782107250.629128:0:17563:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b42eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1868674269220096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782107250.629156:0:17563:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782107250.629200:0:17563:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b42eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1868674269220096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107250.629207:0:17563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:0.0:1782107250.631229:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107250.631238:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107250.631255:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffffa08b435c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269220224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107250.631309:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107250.631365:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269220224 00000100:00100000:0.0:1782107250.631370:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269220224 00000100:00100000:0.0:1782107250.631428:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1782107250.631437:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffffa08b435c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269220224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107250.631456:0:8401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782107250.631495:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffffa08b435c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1868674269220224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107250.631502:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:0.0:1782107250.632703:0:6512:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107250.632751:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08b435c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1868674269220224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107250.632805:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffffa08c7a522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1868674269220096:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782107250.691650:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2253 lines, 2253 kept, 0 dropped, 0 bad.